System and method for class-agnostic counting of one or more items in a container
AssigneeNTT Ltd Group Services America, Inc.
InventorsSai Kwong Yusuf MAI, Mingrui YU
Life of this patent
Estimating the term…
Abstract
The present application pertains to systems and methods of tracking, control, management and counting of objects, items or materials within a monitored area. More particularly, embodiments relate to systems and processes for class-agnostic counting of one or more items in a container in the monitored area.
Claims20
A method of class-agnostic counting of one or more items in a container, said method comprising:
- a. receiving, from one or more detection devices, image data of one or more items of interest placed in a container and a background, said image data comprising three-dimensional (3-D) image data and a two-dimensional (2-D) image data of one or more items of interest placed in the container and the background;
- b. obtaining depth information for each pixel of the 3D image data;
- c. generating, using the depth information, one or more depth masks corresponding to each of one or more items of interest;
- d. extracting, using the one or more depth masks and the 2-D image data, the one or more items of interest from the background to individually segment each of the one or more items of interest;
- e. performing a count of the individually segmented one or more items of interest;
- f. performing object tracking by tracking a location of the container and/or the one or more items of interest in an area;
- g. detecting, using motion detection, if one or more of the items of interest in the container have been removed and/or if additional items of interest have been added to the container;
- and
- h. repeating steps a.-g. until the one or more items of interest and the container reach an exit point in the area, wherein a last count of the one or more items of interest in the container is set as a final count of the one or more items of interest in the container.
A system for class-agnostic counting of one or more items in a container comprising:
- one or more detection devices;
- one or more processors, wherein the one or more processors are in communication with the one or more detection devices, and the one or more processors are in communication with a memory, the memory having stored thereon computer-executable code sections that cause the processor to:
- (a) receive, from the one or more detection devices, image data of one or more items of interest placed in a container and a background, the image data comprising a three-dimensional (3-D) image data and a two-dimensional (2-D) image data of one or more items of interest placed in the container, and the background;
- (b) obtain depth information for each pixel of the 3D image data;
- (c) generate, using the depth information, one or more depth masks corresponding to each of one or more items of interest;
- (d) extract, using the one or more depth masks and the 2-D image data, the one or more items of interest from the background to individually segment each of the one or more items of interest;
- (e) perform a count of the individually segmented one or more items of interest;
- (f) perform object tracking by tracking a location of the container and/or the one or more items of interest in an area;
- (g) detect, using motion detection, if one or more of the items of interest in the container have been removed and/or if additional items of interest have been added to the container;
- and
- (h) repeat steps a.-g. until the one or more items of interest and the container reach an exit point in the area, wherein a last count of the one or more items of interest in the container is set as a final count of the one or more items of interest in the container.
A non-transitory computer-readable medium having computer-executable code sections stored thereon for execution a method of class-agnostic counting of one or more items in a container, said method comprising:
- (a) receiving, from one or more detection devices, image data of one or more items of interest placed in a container and a background, the image data comprising three-dimensional (3-D) image data and a two-dimensional (2-D) image data of one or more items of interest placed in the container and the background;
- (b) obtaining depth information for each pixel of the 3D image data;
- (c) generating, using the depth information, one or more depth masks corresponding to each of one or more items of interest;
- (d) extracting, using the one or more depth masks and the 2-D image data, the one or more items of interest from the background to individually segment each of the one or more items of interest;
- (e) performing a count of the individually segmented one or more items of interest;
- (f) performing object tracking by tracking a location of the container and/or the one or more items of interest in an area;
- (g) detecting, using motion detection, if one or more of the items of interest in the container have been removed and/or if additional items of interest have been added to the container;
- and
- (h) repeating steps a.-g. until the one or more items of interest and the container reach an exit point in the area, wherein a last count of the one or more items of interest in the container is set as a final count of the one or more items of interest in the container.
Dependencies are inferred from the claim text.