US 9,792,502 B2Granted

Generating video summaries for a video using video summary templates

AssigneeGoPro, Inc.

InventorsDavid A. Newman, Brian G. Schunck

Life of this patent

Estimating the term…

Loading patent…

Abstract

Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.

Claims21

Dependent claims

A computer-implemented method for generating a video summary using a video summary template, the method comprising:

receiving, by one or more processors, a request for the video summary of multiple videos;
segmenting the videos into multiple video clips such that at least two of the video clips are segmented from a common one of the videos;
obtaining the video summary template, the video summary template comprising a plurality of template slots, the plurality of template slots including a first template slot and a second template slot, wherein individual template slots are characterized by one or more video clip criteria and one or more quality video clip criteria specific to the individual template slots such that the first template slot is characterized by a first video clip criteria and a first quality video clip criteria and the second template slot is characterized by a second video clip criteria and a second quality video clip criteria;
identifying, for the individual template slots, different sets of candidate video clips from the video clips that satisfy the one or more video clip criteria of the individual template slots;
selecting, for the individual template slots, individual video clips from the sets of candidate video clips based on the one or more quality video clip criteria of the individual template slots, wherein the one or more quality video clip criteria used to select a video clip for a given template slot includes at least one criterion that is not included in the one or more video clip criteria for the given template slot;
and
generating the video summary by placing the selected video clips in the corresponding template slots in the video summary template.

4 more elements

A system for generating a video summary using a video summary template, the system comprising:

one or more physical processors configured by computer-readable instructions to:
receive a request for the video summary of multiple videos;
segment the videos into multiple video clips such that at least two of the video clips are segmented from a common one of the videos;
obtain the video summary template, the video summary template comprising a plurality of template slots, the plurality of template slots including a first template slot and a second template slot, wherein individual template slots are characterized by one or more video clip criteria and one or more quality video clip criteria specific to the individual template slots such that the first template slot is characterized by a first video clip criteria and a first quality video clip criteria and the second template slot is characterized by a second video clip criteria and a second quality video clip criteria;
identify, for the individual template slots, different sets of candidate video clips from the video clips that satisfy the one or more video clip criteria of the individual template slots;
select, for the individual template slots, individual video clips from the sets of candidate video clips based on the one or more quality video clip criteria of the individual template slots, wherein the one or more quality video clip criteria used to select a video clip for a given template slot includes at least one criterion that is not included in the one or more video clip criteria for the given template slot;
and
generate the video summary by placing the selected video clips in the corresponding template slots in the video summary template.

5 more elements

A non-transitory computer-readable storage medium storing instructions for generating a video summary using a video summary template, the instructions, when executed by one or more physical processors, configured to:

receive a request for the video summary of multiple videos;
segment the videos into multiple video clips such that at least two of the video clips are segmented from a common one of the videos;
obtain the video summary template, the video summary template comprising a plurality of template slots, the plurality of template slots including a first template slot and a second template slot, wherein individual template slots are characterized by one or more video clip criteria and one or more quality video clip criteria specific to the individual template slots such that the first template slot is characterized by a first video clip criteria and a first quality video clip criteria and the second template slot is characterized by a second video clip criteria and a second quality video clip criteria;
identify, for the individual template slots, different sets of candidate video clips from the video clips that satisfy the one or more video clip criteria of the individual template slots;
select, for the individual template slots, individual video clips from the sets of candidate video clips based on the one or more quality video clip criteria of the individual template slots, wherein the one or more quality video clip criteria used to select a video clip for a given template slot includes at least one criterion that is not included in the one or more video clip criteria for the given template slot;
and
generate the video summary by placing the selected video clips in the corresponding template slots in the video summary template.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application: 14/513,150Filed 13 Oct 2014 · us provisional application
Priority: 23 Jul 2014
Published: US 2016/0029105 A128 Jan 2016
Granted: 17 Oct 2017
Term ends: Not estimatedThe source records don’t support an estimate.

Classification40 codes

G06V 20/47
Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames: detecting features for…
G06T 7/246
Analysis of motion: using feature-based methods, e.g. the tracking of corners or segments
G06V 20/41
In video content: higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian…
G10L 15/063
Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice: training