US 10,319,410 B1Granted

Video story assembly

AssigneeAmazon Technologies, Inc.

InventorsMatthew Alan Townsend, Peter Van Tuyl Bentley, Gabrielle Halberg, Bryan Harris, Geoff Hunter Donaldson

Life of this patent

Estimating the term…

Loading patent…

Abstract

A system and method is provided for generating an edit decision list used to render a video summarization. The system may determine a structure indicating a pacing and a sequence of video clips included in the video summarization. The system may determine weighted priority metrics for a plurality of video clips, may identify first video clips having a weighted priority metric above a first threshold and may include the first video clips in the video summarization. The system may determine similarity scores for the plurality of video clips, identify second video clips having a weighted priority metric below the first threshold but above a second threshold and a similarity score below a third threshold and may include a portion of the second video clips in the video summarization. The system may determine layouts, apply special effects and transitions and synchronize music with the video summarization based on a theme and annotation data.

Claims20

Dependent claims

A computer-implemented method for generating a video summarization from a corpus of video data, the method comprising:

receiving first video data including a plurality of video clips having a first aspect ratio greater than 2:1;
receiving a request to generate the video summarization using the first video data;
receiving annotation data associated with the plurality of video clips, the annotation data indicating characteristic data associated with individual frames in the first video data;
determining a theme to apply to the video summarization;
determining a configuration for the video summarization including a pacing and a sequence, the pacing indicating a speed associated with the video summarization and the sequence indicating types of video clips to be included in the video summarization;
determining a first characteristic in the characteristic data associated with the theme, the first characteristic indicating a number of faces represented in the first video data;
receiving a second characteristic in the characteristic data associated with the theme, the second characteristic indicating an amount of movement represented in the first video data;
determining a first weight associated with the first characteristic;
determining a second weight associated with the second characteristic;
determining a first priority metric that corresponds to a first measure of interest in at least a portion of a first video clip of the plurality of video clips using the annotation data, the first weight and the second weight;
determining a second priority metric that corresponds to a second measure of interest in at least a portion of a second video clip of the plurality of video clips using the annotation data, the first weight and the second weight;
and
determining a third priority metric that corresponds to a third measure of interest in at least a portion of a third video clip of the plurality of video clips using the annotation data, the first weight and the second weight.

10 more elements

A computer-implemented method, comprising:

receiving video data;
receiving annotation data associated with the video data;
receiving a theme identifier indicating a theme associated with a video summarization;
determining a configuration for the video summarization based on at least one of the annotation data and the theme identifier;
selecting a first video clip from the video data;
selecting a second video clip from the video data;
determining a first similarity score that corresponds to a first similarity between the first video clip and the second video clip;
determining an overall diversity score indicating a diversity of content included in the video data;
determining a first layout for the video summarization, the first layout indicating pixel coordinates associated with the first video clip within a video frame of the video summarization;
determining, based at least in part on the first similarity score and the overall diversity score, an output length for the video summarization;
and
determining that the first video clip is to begin playback in the video summarization before playback of the second video clip.

9 more elements

A system, comprising:

at least one processor;
and
at least one memory including instructions that, when executed by the at least one processor, cause the system to:
receive video data;
receive annotation data associated with the video data;
receive a theme identifier indicating a theme associated with a video summarization;
determine a configuration for the video summarization based on at least one of the annotation data and the theme identifier;
select a first video clip from the video data;
select a second video clip from the video data;
determine a first similarity score that corresponds to a first similarity between the first video clip and the second video clip;
determine an overall diversity score indicating a diversity of content included in the video data;
determine a first layout for the video summarization, the first layout indicating first pixel coordinates associated with the first video clip within a video frame of the video summarization;
determine, based at least in part on the first similarity score and the overall diversity score, an output length for the video summarization;
and
determine that the first video clip is to begin playback in the video summarization before playback of the second video clip.

12 more elements

Dependencies are inferred from the claim text.

Facts

Application: 14/977,134Filed 21 Dec 2015
Granted: 11 Jun 2019
Term ends: Not estimatedThe source records don’t support an estimate.

Classification5 codes

G11B 27/031
Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers: electronic editing of digitised analogue…
G11B 27/034
Electronic editing of digitised analogue information signals, e.g. audio or video signals: on discs
G11B 27/105
Programmed access in sequence to addressed parts of tracks of operating record carriers: of operating discs
G11B 27/30
By using information signals recorded by the same method as the main recording: on the same track as the main recording

Family

No related US applications are recorded in the indexed filing history.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key