Multimedia enrichment and rendering with computing devices
OwnerField J. GARTHWAITE, Thomas J. SULLIVAN +1inventors
InventorsField J. GARTHWAITE, Thomas J. SULLIVAN, Jenifer L. JORDAN
Life of this patent
Estimating the term…
Abstract
Computer vision techniques are applied to a video segment to identify a specific media content category. A media context metadata portion including a specific media content indicator indicating the specific media content category is generated. When the video segment is to be played back, an enriching media content item is selected from among enriching media content items based on the specific media content indicator and played back before, after or during the video segment.
Claims21
A computer-implemented method, comprising:
- applying, by one or more computer processors, one or more computer vision techniques to a to-be-enriched video segment to identify a specific media content category of the video segment based on what is visually depicted in the to-be-enriched video segment;
- generating, by the one or more computer processors, a media context metadata portion that includes a specific media content indicator indicating the specific media content category of the to-be-enriched video segment;
- in response to determining that the to-be-enriched video segment is to be played back by a user computing device, performing by the one or more computer processors:
- selecting an enriching media content item from among a plurality of enriching media content items based at least in part on the specific media content indicator indicating the specific media content category of the to-be-enriched video segment;
- causing the enriching media content item to be played back with the to-be-enriched video segment on an image display operating in conjunction with the user computing device, wherein the enriching media content item is played back in a time duration before, after or during the to-be-enriched video segment.
A system comprising:
- one or more computer processors;
- one or more non-transitory computer-readable media, storing one or more sequences of instructions, wherein execution of the one or more sequences of instructions by the one or more computer processors causes the one or more computer processors to perform:
- applying, by one or more computer processors, one or more computer vision techniques to a to-be-enriched video segment to identify a specific media content category of the video segment based on what is visually depicted in the to-be-enriched video segment;
- generating, by the one or more computer processors, a media context metadata portion that includes a specific media content indicator indicating the specific media content category of the to-be-enriched video segment;
- in response to determining that the to-be-enriched video segment is to be played back by a user computing device, performing by the one or more computer processors:
- selecting an enriching media content item from among a plurality of enriching media content items based at least in part on the specific media content indicator indicating the specific media content category of the to-be-enriched video segment;
- causing the enriching media content item to be played back with the to-be-enriched video segment on an image display operating in conjunction with the user computing device, wherein the enriching media content item is played back in a time duration before, after or during the to-be-enriched video segment.
One or more non-transitory computer-readable media, storing one or more sequences of instructions, wherein execution of the one or more sequences of instructions by one or more computer processors causes the one or more processors to perform:
- applying, by one or more computer processors, one or more computer vision techniques to a to-be-enriched video segment to identify a specific media content category of the video segment based on what is visually depicted in the to-be-enriched video segment;
- generating, by the one or more computer processors, a media context metadata portion that includes a specific media content indicator indicating the specific media content category of the to-be-enriched video segment;
- in response to determining that the to-be-enriched video segment is to be played back by a user computing device, performing by the one or more computer processors:
- selecting an enriching media content item from among a plurality of enriching media content items based at least in part on the specific media content indicator indicating the specific media content category of the to-be-enriched video segment;
- causing the enriching media content item to be played back with the to-be-enriched video segment on an image display operating in conjunction with the user computing device, wherein the enriching media content item is played back in a time duration before, after or during the to-be-enriched video segment.
Dependencies are inferred from the claim text.