Systems and methods to track objects in video
Assignee612 Authentic Media DBA CrumplePop
InventorGabriel Cheifetz
Life of this patent
Estimating the term…
Abstract
Systems and methods to track objects in video are disclosed. Exemplary implementations may obtain a user entry and/or selection of a depiction of an object visible within a first frame of a video and process the depiction of the object for use as a current reference. For subsequent frames, the systems and methods may determine whether the depiction of the object is visible. If the depiction of the object is no longer visible within a particular frame, image features of subsequent frames are compared with the latest reference of the depiction of the object until the depiction of the object is visible again. If and when the object is visible, an object indicator may be displayed on the relevant frames and/or otherwise presented to a viewer.
Claims20
A system configured to track objects in video, the system comprising:
- one or more hardware processors configured by machine-readable instructions to:
- obtain view information for a video comprising multiple consecutive frames, the view information defining visual content, the visual content including depictions of objects and/or surfaces, the view information defining the visual content in the form of images, an individual image forming an individual frame of the video;
- obtain a user entry and/or selection of a depiction of an object visible within a first frame;
- identify a pattern of motion of the depiction of the object between a first frame and a second frame to track a location of the depiction of the object from the first frame to the second frame, the second frame being adjacent to the first frame;
- in response to the depiction of the object within the second frame being viable as a reference, process the depiction of the object for use as a current reference;
- determine whether the depiction of the object is no longer visible within a third frame;
- extract image features for a fourth frame in response to determining the depiction of the object is no longer visible within the third frame;
- compare the image features of the fourth frame with the current reference of the depiction of the object;
- and
- determine, based on the comparison, whether the depiction of the object is visibly present in the fourth frame, such that responsive to comparing image features of a fourth frame with the current reference of the depiction of the object, and determining that the image features of the fourth frame match the current reference of the depiction of the object, determine that the depiction of the object is visibly present within the fourth frame.
A computer-implemented method to track objects in video, the method comprising:
- obtaining view information for a video comprising multiple consecutive frames, the view information defining visual content, the visual content including depictions of objects and/or surfaces, the view information defining the visual content in the form of images, an individual image forming an individual frame of the video;
- obtaining a user entry and/or selection of a depiction of an object visible within a first frame;
- identifying a pattern of motion of the depiction of the object between a first frame and a second frame to track a location of the depiction of the object from the first frame to the second frame, the second frame being adjacent to the first frame;
- in response to the depiction of the object within the second frame being viable as a reference, processing the depiction of the object for use as a current reference;
- determining whether the depiction of the object is no longer visible within a third frame;
- extracting image features for a fourth frame in response to determining the depiction of the object is no longer visible within the third frame;
- comparing the image features of the fourth frame with the current reference of the depiction of the object;
- and
- determining, based on the comparison, whether the depiction of the object is visibly present in the fourth frame, such that responsive to comparing image features of a fourth frame with the current reference of the depiction of the object, and determining that the image features of the fourth frame match the current reference of the depiction of the object, determine that the depiction of the object is visibly present within the fourth frame.
Dependencies are inferred from the claim text.