US 2021/0232811 A1Published application

Systems and methods for machine vision based object recognition

AssigneeSynchrony Bank

InventorsUjjval Patel, Xiaodan Du, Lucas McDonald

Life of this patent

Estimating the term…

Loading patent…

Abstract

The present disclosure is related to object recognition and tracking using multi-camera driven machine vision. In one aspect, a method includes capturing, via a multi-camera system, a plurality of images of a user, each of the plurality of images representing the user from a unique angle; identifying, using the plurality of images, the user; detecting, throughout a facility, an item selected by the user; creating a visual model of the item to track movement of the item throughout the facility; determining, using the visual model, whether the item is selected for purchase; and detecting that the user is leaving the facility; and processing a transaction for the item when the item is selected for purchase and when the user has left the facility.

Claims32

Dependent claims

A computer-implemented method, comprising:

receiving at a processing system, a plurality of images corresponding to a user, wherein the plurality of images are associated with a plurality of cameras, and wherein the plurality of images represent the user;
using the plurality of images and the processing system to identify the user;
detecting an item selected by the user, wherein detection is done by the processing system and throughout a facility;
generating a visual model of the item, wherein the visual model is generated using the processing system;
using the processing system to associate one or more instances of the visual model and one or more corresponding spatial coordinates with one or more of the plurality of cameras throughout the facility;
tracking to track movement of the item throughout the facility, wherein tracking is based on instances of the visual model and corresponding spatial coordinates associated with the one or more of the plurality of cameras;
determining whether the item is selected for purchase, wherein the determination is based on the tracked movement, and wherein the determination is made by the processing system;
detecting that the user is leaving the facility, wherein the detection is performed by the processing system;
and
processing a transaction for the item when the item is selected for purchase and when the user has left the facility, wherein processing of the transaction is done by the processing system.

7 more elements

One or more non-transitory computer-readable media comprising computer-readable instructions, which when executed by one or more processors, cause the one or more processors to:

receive a plurality of images corresponding to a user, each of the plurality of images are associated with a plurality of cameras, and wherein the plurality of images represent the user;
identify, using the plurality of images, the user;
detect, throughout a facility, an item selected by the user;
generate a visual model of the item;
associate one or more instances of the visual model and one or more spatial coordinates with one or more of the plurality of cameras;
track movement of the item throughout the facility based on instances of the visual model and the corresponding spatial coordinates associated with the one or more of the plurality of cameras;
determine whether the item is selected for purchase based on the tracked movement;
detect that the user is leaving the facility;
and
process a transaction for the item when the item is selected for purchase and when the user has left the facility.

7 more elements

Dependencies are inferred from the claim text.