Back to results
US 11,776,261 B2Granted
Context-aware event based annotation system for media asset
AssigneeSpherex, Inc.
InventorsTeresa Ann Phillips, Pranav Anand Joshi, Kira Michelle McStay
Life of this patent
Estimating the term…
Abstract
Various embodiments described herein support or provide for annotation of a media asset, such as an audio asset or a video asset, based on one or more events identified within content of the media asset. In particular, some embodiments can determine one or more of the following details with respect to content of a given media asset, which can represent annotations that enable determination of contextual information for the given media asset: events; event classification labels for events; subclassifications labels for events; scenes comprising events; attributes of scenes; themes presented by the content; and title-level attributes of the given media asset.
Claims25
A method comprising:
- accessing, by a hardware processor, content data for a current media asset;
- determining, by the hardware processor, a set of events within the content data by scanning the content data for events that relate to at least one event classification, each event in the set of events comprising at least one of a visual content element, a textual content feature, or an audio content feature from the content data being presented at a timestamp of the current media asset, each event in the set of events being associated with an event classification label selected from a predetermined event classification library, the predetermined event classification library comprising a plurality of event classification labels where each event classification label comprises a set of available event subclassification labels;
- for each individual event in the set of events and based on an identified event classification label of the individual event, determining a set of identified event subclassification labels for the individual event, the set of identified event subclassification labels being selected from the set of available subclassification labels for the identified event classification as provided by the predetermined event classification library, at least one identified event subclassification label in the set of identified event subclassification labels describing at least:
- an intent of a context of the individual event;
- and
- an outcome of the context of the individual event;
- determining, by the hardware processor, a set of scenes within the content data, each scene in the set of scenes comprising a subset of events from the set of events;
- for each individual scene in the set of scenes, determining a set of scene attributes for the individual scene;
- determining, by the hardware processor, a set of themes for the current media asset based on at least one of the set of scenes or the set of scene attributes;
- determining, by the hardware processor, a set of title attributes for the current media asset based on at least the set of themes and metadata associated with the media asset;
- and
- generating, by the hardware processor, contextual data for the current media asset based on at least one of the set of events, the set of event classification labels determined for the set of events, the sets of identified event subclassification labels determined for the set of events, the set of scenes, sets of scene attributes for the set of scenes, the set of themes, or the set of title attributes.
9 more elements
A system comprising:
- a memory storing instructions;
- and
- one or more hardware processors communicatively coupled to the memory and configured by the instructions to perform operations comprising:
- accessing content data for a current media asset;
- determining a set of events within the content data by scanning the content data for events that relate to at least one event classification, each event in the set of events comprising at least one of a visual content element, a textual content feature, or an audio content feature from the content data being presented at a timestamp of the current media asset, each event in the set of events being associated with an event classification label selected from a predetermined event classification library, the predetermined event classification library comprising a plurality of event classification labels where each event classification label comprises a set of available event subclassification labels;
- for each individual event in the set of events and based on an identified event classification label of the individual event, determining a set of identified event subclassification labels for the individual event, the set of identified event subclassification labels being selected from the set of available subclassification labels for the identified event classification as provided by the predetermined event classification library, at least one identified event subclassification label in the set of identified event subclassification labels describing at least:
- an intent of a context of the individual event;
- and
- an outcome of the context of the individual event;
- determining a set of scenes within the content data, each scene in the set of scenes comprising a subset of events from the set of events;
- for each individual scene in the set of scenes, determining a set of scene attributes for the individual scene;
- determining a set of themes for the current media asset based on at least one of the set of scenes or the set of scene attributes;
- determining a set of title attributes for the current media asset based on at least the set of themes and metadata associated with the media asset;
- and
- generating contextual data for the current media asset based on at least one of the set of events, the set of event classification labels determined for the set of events, the sets of identified event subclassification labels determined for the set of events, the set of scenes, sets of scene attributes for the set of scenes, the set of themes, or the set of title attributes.
12 more elements
A non-transitory computer-readable medium comprising instructions that, when executed by a hardware processor of a device, cause the device to perform operations comprising:
- accessing content data for a current media asset;
- determining a set of events within the content data by scanning the content data for events that relate to at least one event classification, each event in the set of events comprising at least one of a visual content element, a textual content feature, or an audio content feature from the content data being presented at a timestamp of the current media asset, each event in the set of events being associated with an event classification label selected from a predetermined event classification library, the predetermined event classification library comprising a plurality of event classification labels where each event classification label comprises a set of available event subclassification labels;
- for each individual event in the set of events and based on an identified event classification label of the individual event, determining a set of identified event subclassification labels for the individual event, the set of identified event subclassification labels being selected from the set of available subclassification labels for the identified event classification as provided by the predetermined event classification library, at least one identified event subclassification label in the set of identified event subclassification labels describing at least:
- an intent of a context of the individual event;
- and
- an outcome of the context of the individual event;
- determining a set of scenes within the content data, each scene in the set of scenes comprising a subset of events from the set of events;
- for each individual scene in the set of scenes, determining a set of scene attributes for the individual scene;
- determining a set of themes for the current media asset based on at least one of the set of scenes or the set of scene attributes;
- determining a set of title attributes for the current media asset based on at least the set of themes and metadata associated with the media asset;
- and
- generating contextual data for the current media asset based on at least one of the set of events, the set of event classification labels determined for the set of events, the sets of identified event subclassification labels determined for the set of events, the set of scenes, sets of scene attributes for the set of scenes, the set of themes, or the set of title attributes.
9 more elements
Dependencies are inferred from the claim text.