US 2021/0201253 A1 · SYSTEMS AND METHODS FOR DEEP LEARNING-BASED SHOPPER TRACKING

Abstract

Systems and techniques are provided for tracking puts and takes of inventory items by subjects in an area of real space. A plurality of cameras with overlapping fields of view produce respective sequences of images of corresponding fields of view in the real space. In one embodiment, the system includes first image processors, including subject image recognition engines, receiving corresponding sequences of images from the plurality of cameras. The first image processors process images to identify subjects represented in the images in the corresponding sequences of images. The system includes second image processors, including background image recognition engines, receiving corresponding sequences of images from the plurality of cameras. The second image processors mask the identified subjects to generate masked images. Following this, the second image processors process the masked images to identify and classify background changes represented in the images in the corresponding sequences of images.

Claims20

Dependent claims

A method for identifying customer selection of an inventory item, the method comprising:

using a first camera to produce first one or more images of a customer holding an inventory item during a first time period in a first field of view of the first camera;
using a second camera to produce second one or more images of the customer holding the inventory item during the first time period in a second field of view of the second camera, the first and the second field of views at least partially overlapping, and the customer holding the inventory during the first time period is within an overlapping region of the first and the second field of views;
generating, based on the first one or more images and independent of the second one or more images, a first evaluation of the inventory item;
generating, based on the second one or more images and independent of the first one or more images, a second evaluation of the inventory item;
determining, based on the first evaluation and the second evaluation, a final evaluation of the inventory item;
and
triggering, at least in part in response to the final evaluation of the inventory item, an action.

4 more elements

Dependencies are inferred from the claim text.

Systems and methods for deep learning-based shopper tracking

Life of this patent

Systems and methods for deep learning-based shopper tracking

Life of this patent

Abstract

Claims20