Back to results
US 11,776,262 B1Granted
Identifying compelling scenes at scale by mapping characteristics
AssigneeAmazon Technologies, Inc.
InventorsKewen Chen, Tu Anh Ho, Christina Botkins, Najmeh Sadoughi Nourabadi
Life of this patent
Estimating the term…
Abstract
Methods and apparatus are described for generating compelling preview clips of media presentations. Compelling clips are identified based on weighted combinations of attribute scores determined for indices of a media presentation. One or more of these compelling clips are then provided to a client device for playback.
Claims20
A method, comprising:
- identifying a plurality of indices, each index corresponding to a continuous portion of a media presentation that is associated with one or more timestamps or one or more frames;
- determining a set of attribute scores for each index, wherein each attribute score represent a confidence level that a corresponding attribute applies to a corresponding portion of the media presentation, wherein at least some of the attribute scores are determined by applying a classifier trained on clips that correspond with one of a plurality of action attributes or one of a plurality of emotion attributes;
- applying a set of weights to the set of attribute scores, each weight representing a compelling-ness of an attribute;
- determining a compelling-ness score for each index based on the set of attribute scores and the set of weights;
- identifying a plurality of clips based on the compelling-ness scores, wherein each clip includes a contiguous range of content of the media presentation beginning and ending at corresponding shot boundaries, each clip corresponding to a contiguous range of the plurality of indices;
- determining a clip compelling-ness score for each clip of the plurality of clips based on the compelling-ness score for each index included in that clip;
- ranking the plurality of clips based on the clip compelling-ness scores;
- identifying a subset of the plurality of clips based on the ranking of the plurality of clips, and
- providing one or more clips of the subset of the plurality of clips to a first client device.
6 more elements
A method, comprising:
- identifying a plurality of indices, each index corresponding to a portion of a media presentation that is associated with one or more timestamps or one or more frames;
- determining a set of attribute scores for each index, each attribute score of a subset of the attribute scores representing a confidence level that a corresponding attribute applies to the corresponding portion of the media presentation, wherein the subset of attribute scores includes attribute scores for a plurality of action attributes and a plurality of emotion attributes;
- applying a set of weights to the set of attribute scores, each weight representing a compelling-ness of an attribute;
- determining a compelling-ness score for each index based on the set of attribute scores and the set of weights;
- identifying a plurality of clips based on the compelling-ness scores corresponding to the indices within each respective clip of the plurality of clips;
- and
- providing one or more clips of the plurality of clips to a first client device.
4 more elements
A system, comprising memory and one or more processors configured to:
- identify a plurality of indices, each index corresponding to a portion of a media presentation that is associated with one or more timestamps or one or more frames;
- determine a set of attribute scores for each index, each attribute score of a subset of the attribute scores representing a confidence level that a corresponding attribute applies to the corresponding portion of the media presentation, wherein the subset of attribute scores includes attribute scores for a plurality of action attributes and a plurality of emotion attributes;
- apply a set of weights to the set of attribute scores, each weight representing a compelling-ness of an attribute;
- determine a compelling-ness score for each index based on the set of attribute scores and the set of weights;
- identify a plurality of clips based on the compelling-ness scores corresponding to the indices within each respective clip of the plurality of clips;
- and
- provide one or more clips of the plurality of clips to a first client device.
4 more elements
Dependencies are inferred from the claim text.