Apparatus and methods of automated tracking and counting of objects on a resource-constrained device
AssigneeMicrosoft Technology Licensing, LLC
InventorsDonna Katherine Long, Arthur Charles Tomlin, Kenneth Liam Kiemele, John Benjamin Hesketh
Life of this patent
Estimating the term…
Abstract
The present disclosure provides apparatus and methods for automated tracking and counting of objects in a set of image frames using a resource-constrained device based on analysis of a selected subset of image frames, and based on selectively timing when resource-intensive operations are performed.
Claims17
An automated object tracking and counting system, comprising:
- a memory comprising instructions;
- and
- a processor in communication with the memory and configured to execute the instructions, wherein the processor is configured to:
- obtain a set of image frames captured over time;
- detect one or more objects in the set of image frames;
- track positioning of the detected one or more objects in each of the set of image frames;
- determine whether a current timing condition meets one or more classification timing rules;
- select a subset of image frames from the set of image frames based on a selection parameter of each of the subset of image frames meeting a selection criteria, in response to the current timing condition meeting the one or more classification timing rules, wherein the selection parameter includes a distance of a position of each of the subset of image frames to a target position of a target image frame, and wherein the selection criteria comprises a number of image frames having a lowest distance to the target position of the target image frame;
- classify as a respective object type each of the detected one or more objects;
- count a number of the classified object types in the subset of image frames;
- and
- output the number of the classified object types as a current count of the classified object type.
An automated method of counting objects, comprising:
- receiving a plurality of image frames from a camera;
- detecting at least a first unidentified object in each of a first set of the plurality of image frames;
- tracking at least the first unidentified object through the first set of the plurality of image frames;
- determining a selection parameter associated with each of the first set of the plurality of image frames;
- selecting a subset of image frames from the first set of the plurality of image frames based on each selection parameter of the subset of image frames meeting a selection criteria, wherein each selection parameter includes a distance of a position of each of the subset of image frames to a target position of a target image frame, and wherein the selection criteria comprises a number of image frames having a lowest distance to the target position of the target image frame;
- determining that a classification timing trigger meets a trigger condition;
- automatically classifying at least the first unidentified object as a first type of object based on analyzing the subset of image frames in response to the classification timing trigger meeting the trigger condition;
- identifying a number of the first type of object in the subset of image frames to define a current count;
- updating a total count of the first type of object based on the number of the first type of object defined by the current count;
- and
- outputting the current count and/or the total count of the first type of object.
A non-transitory computer-readable medium storing instructions for automated object tracking and counting that are executable by a processor, comprising:
- instructions to cause the processor to obtain a set of image frames captured over time;
- instructions to cause the processor to detect one or more objects in the set of image frames;
- instructions to cause the processor to track positioning of the detected one or more objects in each of the set of image frames;
- instructions to cause the processor to determine whether a current timing condition meets one or more classification timing rules;
- instructions to cause the processor to select a subset of image frames from the set of image frames based on a selection parameter of each of the subset of image frames meeting a selection criteria, in response to the current timing condition meeting the one or more classification timing rules, wherein the selection parameter includes a distance of a position of each of the subset of image frames to a target position of a target image frame, and wherein the selection criteria comprises a number of image frames having a lowest distance to the target position of the target image frame;
- instructions to cause the processor to classify as a respective object type each of the detected one or more objects;
- instructions to cause the processor to count a number of the classified object types in the subset of image frames;
- and
- instructions to cause the processor to output the number of the classified object types as a current count of the classified object type.
Dependencies are inferred from the claim text.