Back to results
US 9,177,225 B1Granted
Interactive content generation
AssigneeOim Squared Inc.
InventorsBertin Rudolph Cordova-Diba, Jose Adrian Munguia, Tyson Simon, Eric Williams
Life of this patent
Estimating the term…
Abstract
Generation of interactive content. In an embodiment, a representation of candidate object(s) in content of a digital media asset are received. For each of the candidate object(s), feature(s) of the candidate object are compared to corresponding feature(s) of a plurality of reference objects to identify reference object(s) that match the candidate object. For each of the matched candidate object(s), a hotspot package is generated. The hotspot package may comprise a visual overlay which comprises information associated with the reference object(s) matched to the respective candidate object.
Claims30
A computer-implemented method that comprises using at least one hardware processor to:
- receive a representation of one or more candidate objects in content of a digital media asset, wherein the digital media asset comprises a video, and wherein the representation of one or more candidate objects comprises a first frame of the video;
- for each of the one or more candidate objects, compare one or more features of the candidate object to one or more corresponding features of a plurality of reference objects to identify one or more reference objects that match the candidate object;
- for each of the one or more candidate objects that is matched to one or more reference objects, generate a hotspot package, wherein the hotspot package comprises a visual overlay and a display position that is based on a position of the candidate object, and wherein the visual overlay comprises information associated with the one or more reference objects matched to the candidate object;
- and,
- after generating a hotspot package for each of the one or more candidate objects that is matched to one or more reference objects,
- receive a second frame of the video that is subsequent in time to the first frame of the video,
- determine whether the second frame represents a different scene than the first frame,
- when the second frame is determined to represent a different scene than the first frame, for each of one or more candidate objects in the second frame, compare one or more features of the candidate object to one or more corresponding features of a plurality of reference objects to identify one or more reference objects that match the candidate object, and, for each of the one or more candidate objects in the second frame that is matched to one or more reference objects, generate a hotspot package, and,
- when the second frame is not determined to represent a different scene than the first frame, for each hotspot package generated for the one or more candidate objects that are matched to one or more reference objects, determine a change in a position of the candidate object, for which the hotspot package was generated, from a frame preceding the second frame to the position of the candidate object in the second frame, and update the display position of the hotspot package based on the determined change in position of the candidate object.
6 more elements
A system comprising:
- at least one hardware processor;
- and
- one or more software modules that are configured to, when executed by the at least on hardware processor,
- receive a representation of one or more candidate objects in content of a digital media asset, wherein the digital media asset comprises a video, and wherein the representation of one or more candidate objects comprises a first frame of the video,
- for each of the one or more candidate objects, compare one or more features of the candidate object to one or more corresponding features of a plurality of reference objects to identify one or more reference objects that match the candidate object,
- for each of the one or more candidate objects that is matched to one or more reference objects, generate a hotspot package, wherein the hotspot package comprises a visual overlay and a display position that is based on a position of the candidate object, and wherein the visual overlay comprises information associated with the one or more reference objects matched to the candidate object, and,
- after generating a hotspot package for each of the one or more candidate objects that is matched to one or more reference objects,
- receive a second frame of the video that is subsequent in time to the first frame of the video,
- determine whether the second frame represents a different scene than the first frame,
- when the second frame is determined to represent a different scene than the first frame, for each of one or more candidate objects in the second frame, compare one or more features of the candidate object to one or more corresponding features of a plurality of reference objects to identify one or more reference objects that match the candidate object, and, for each of the one or more candidate objects in the second frame that is matched to one or more reference objects, generate a hotspot package, and,
- when the second frame is not determined to represent a different scene than the first frame, for each hotspot package generated for the one or more candidate objects that are matched to one or more reference objects, determine a change in a position of the candidate object, for which the hotspot package was generated, from a frame preceding the second frame to the position of the candidate object in the second frame, and update the display position of the hotspot package based on the determined change in position of the candidate object.
8 more elements
A non-transitory computer-readable medium having instructions stored thereon, wherein the instructions, when executed by a processor, cause the processor to:
- receive a representation of one or more candidate objects in content of a digital media asset, wherein the digital media asset comprises a video, and wherein the representation of one or more candidate objects comprises a first frame of the video;
- for each of the one or more candidate objects, compare one or more features of the candidate object to one or more corresponding features of a plurality of reference objects to identify one or more reference objects that match the candidate object;
- for each of the one or more candidate objects that is matched to one or more reference objects, generate a hotspot package, wherein the hotspot package comprises a visual overlay and a display position that is based on a position of the candidate object, and wherein the visual overlay comprises information associated with the one or more reference objects matched to the candidate object;
- and,
- after generating a hotspot package for each of the one or more candidate objects that is matched to one or more reference objects,
- receive a second frame of the video that is subsequent in time to the first frame of the video,
- determine whether the second frame represents a different scene than the first frame,
- when the second frame is determined to represent a different scene than the first frame, for each of one or more candidate objects in the second frame, compare one or more features of the candidate object to one or more corresponding features of a plurality of reference objects to identify one or more reference objects that match the candidate object, and, for each of the one or more candidate objects in the second frame that is matched to one or more reference objects, generate a hotspot package, and,
- when the second frame is not determined to represent a different scene than the first frame, for each hotspot package generated for the one or more candidate objects that are matched to one or more reference objects, determine a change in a position of the candidate object, for which the hotspot package was generated, from a frame preceding the second frame to the position of the candidate object in the second frame, and update the display position of the hotspot package based on the determined change in position of the candidate object.
6 more elements
Dependencies are inferred from the claim text.