Back to results
US 12,587,717 B2Granted
Facilitating video generation
Assignee10Z, LLC.
InventorsPhilip Martin Meier, Csaba Matyas Petre
Life of this patent
Estimating the term…
Abstract
Features described herein generally relate to content production. Particularly, the present disclosure relates to facilitating video generation. Using machine-learning models, a storyboard can be generated from an inspirational video, video attributes can be determined for the storyboard, editing scores and actions can be determined for candidate videos, candidate videos can be edited based on the editing scores and actions, and the edited candidate videos can be combined to generate a video.
Claims20
A method for facilitating video generation, the method comprising:
- identifying a first video;
- segmenting the first video into a plurality of video segments;
- automatically generating a plurality of storyboard panels based on the plurality of video segments using a machine-learning model, each storyboard panel of the plurality of storyboard panels representing at least one video segment of the plurality of video segments;
- automatically determining a plurality of video attributes by processing each video segment of the plurality of video segments, each video attribute of the plurality of video attributes corresponding to a storyboard panel of the plurality of storyboard panels;
- identifying a plurality of second videos, each second video of the plurality of second videos corresponding to at least one video attribute of the plurality of video attributes;
- determining a plurality of editing scores or a plurality of editing actions for the plurality of second videos by processing the plurality of second videos using another machine-learning model;
- and
- editing the plurality of second videos based on the plurality of editing scores or the plurality of editing actions;
- combining the second videos to generate a third video;
- and
- outputting the third video.
8 more elements
A system for facilitating video generation comprising:
- one or more processors;
- and
- one or more memories, the one or more memories storing instructions which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
- identifying a first video;
- segmenting the first video into a plurality of video segments;
- automatically generating a plurality of storyboard panels based on the plurality of video segments using a machine-learning model, each storyboard panel of the plurality of storyboard panels representing at least one video segment of the plurality of video segments;
- automatically determining a plurality of video attributes by processing each video segment of the plurality of video segments, each video attribute of the plurality of video attributes corresponding to a storyboard panel of the plurality of storyboard panels;
- identifying a plurality of second videos, each second video of the plurality of second videos corresponding to at least one video attribute of the plurality of video attributes;
- determining a plurality of editing scores or a plurality of editing actions for the plurality of second videos by processing the plurality of second videos using another machine-learning model;
- and
- editing the plurality of second videos based on the plurality of editing scores or the plurality of editing actions;
- combining the second videos to generate a third video;
- and
- outputting the third video.
11 more elements
One or more non-transitory computer-readable media storing computer-readable instructions that, when executed by one or more processors, cause the one or more processors to perform operations including:
- identifying a first video;
- segmenting the first video into a plurality of video segments;
- automatically generating a plurality of storyboard panels based on the plurality of video segments using a machine-learning model, each storyboard panel of the plurality of storyboard panels representing at least one video segment of the plurality of video segments;
- automatically determining a plurality of video attributes by processing each video segment of the plurality of video segments, each video attribute of the plurality of video attributes corresponding to a storyboard panel of the plurality of storyboard panels;
- identifying a plurality of second videos, each second video of the plurality of second videos corresponding to at least one video attribute of the plurality of video attributes;
- determining a plurality of editing scores or a plurality of editing actions for the plurality of second videos by processing the plurality of second videos using another machine-learning model;
- and
- editing the plurality of second videos based on the plurality of editing scores or the plurality of editing actions;
- combining the second videos to generate a third video;
- and
- outputting the third video.
8 more elements
Dependencies are inferred from the claim text.