US 11,107,222 B2Granted

Video object tracking

AssigneeFigure Eight Technologies, Inc.

InventorsKiran Vajapey, Robert Munro, Joseph Richard Cloughley, Matthew Allen Gordon, Humayun Irshad, Monchu Chen, Seyyedeh Qazale Mirsharif, Caiqun Xiao

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

A technique is disclosed for automating tracking of annotated objects and improves the throughput and efficiency of existing methods while maintaining a degree of accuracy comparable to a human annotator. In particular, the disclosed technique provides an automated annotated object tracking tool that allows machine-learning teams to annotate an object within a frame and have that annotation persist across frames as the annotated object is tracked within a series of frames, still ensuring that every frame is accurately reviewed by a human where high quality annotation is required. This technique incorporates human feedback via a user adjustment that allows the tool to adapt and improve its accuracy in tracking an annotated object across a sequence of frames.

Claims19

Dependent claims

A system for object-level tracking comprising:

a processor and a memory coupled with the processor, wherein the memory is configured to provide the processor with instructions which when executed cause the processor to:
present a first frame in a series of pre-recorded frames;
receive a first annotation of a first bounding region of an object in the first frame;
assign an object identifier associated with the first bounding region;
obtain a second bounding region of the object in a second frame in the series of pre-recorded frames based at least in part on a prediction of a location of the object in the second frame, wherein the second bounding region is associated with the object identifier;
output the second bounding region;
maintain a prediction of the location of the object in subsequent frames using the object identifier;
predict the location of the object in the second frame;
receive a user adjustment of the prediction;
determine a difference between the prediction and the user adjustment;
and
adjust a subsequent prediction of a location of the object in a subsequent frame in response to the difference.

9 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/657,151Filed 18 Oct 2019 · continuation
Priority: 9 May 2018
Published: US 2020/0151884 A114 May 2020
Granted: 31 Aug 2021
Term ends: Not estimatedThe source records don’t support an estimate.

Classification12 codes

G06T 7/20
Image analysis: analysis of motion
G06T 7/246
Analysis of motion: using feature-based methods, e.g. the tracking of corners or segments
G06T 7/70
Image analysis: determining position or orientation of objects or cameras
G06T 2200/24
Indexing scheme for image data processing or generation, in general: involving graphical user interfaces [GUIs]

Family

Application62/669,259Us provisional application · filed 9 May 2018
Application16/228,579Parent of this continuation · filed 20 Dec 2018
US 2020/0151884 A1Pre-grant publication · published 14 May 2020
US 10,489,918 B1Parent of this continuation
US 2019/0347806 A1Published application
US 11,107,222 B2This patent

From the US filing history. Foreign family members aren’t listed.