US 11,538,186 B2 · Systems and methods to check-in shoppers in a cashier-less store

Abstract

Systems and techniques are provided for linking subjects in an area of real space with user accounts. The user accounts are linked with client applications executable on mobile computing devices. A plurality of cameras are disposed above the area. The cameras in the plurality of cameras produce respective sequences of images in corresponding fields of view in the real space. A processing system is coupled to the plurality of cameras. The processing system includes logic to determine locations of subjects represented in the images. The processing system further includes logic to match the identified subjects with user accounts by identifying locations of the mobile computing devices executing client applications in the area of real space and matching locations of the mobile computing devices with locations of the subjects.

Claims20

Dependent claims

A method for linking subjects in an area of real space with corresponding user accounts, the user accounts being linked with client applications executable on mobile computing devices, the method including:

receiving a sequence of images of the area of real space;
identifying one or more subjects in the sequence of images, and determining velocities of the one or more subjects in the sequence of images;
determining velocities of one or more mobile computing devices in the area of real space, based on data transmitted by the one or more mobile computing devices;
comparing (i) the determined velocities of the one or more subjects in the sequence of images and (ii) the determined velocities of the one or more mobile computing devices;
based on the comparing, matching a first mobile computing device of the one or more mobile computing devices with a first subject of the one or more subjects;
and
linking the first subject with a first user account linked to a first client application being executed on the first mobile device.

4 more elements

A non-transitory computer readable storage medium impressed with computer program instructions to link subjects in an area of real space with corresponding user accounts, the user accounts being linked with client applications executable on mobile computing devices, the instructions, when executed on a processor, implement a method comprising:

receiving sensor data from the area of real space;
determining velocities of the one or more subjects, based on the sensor data;
determining velocities of one or more mobile computing devices in the area of real space, based on data transmitted by the one or more mobile computing devices;
determining a norm between (i) a velocity of a first mobile computing device of the one or more mobile computing devices and (ii) a velocity of a first subject of the one or more subjects;
and
in response to the norm being less than a threshold, linking the first subject with a first user account linked to a first client application being executed on the first mobile device.

3 more elements

A system for linking subjects in an area of real space with corresponding user accounts, the user accounts being linked with client applications executable on mobile computing devices, comprising:

a processing system configured to receive a sequence of images of the area of real space, the processing system including:
first logic to identify one or more subjects in the sequence of images, and determine velocities of the one or more subjects in the sequence of images;
second logic to determine velocities of one or more mobile computing devices in the area of real space, based on data transmitted by the one or more mobile computing devices;
third logic to compare (i) the determined velocities of the one or more subjects in the sequence of images and (ii) the determined velocities of the one or more mobile computing devices;
fourth logic to match a first mobile computing device of the one or more mobile computing devices with a first subject of the one or more subjects, based on the comparing;
and
fifth logic to link the first subject with a first user account linked to a first client application being executed on the first mobile device.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application

17/383,303Filed 22 Jul 2021 · continuation

Priority

7 Aug 2017

Published

US 2021/0350568 A111 Nov 2021

Granted

27 Dec 2022

Term ends

Not estimatedThe source records don’t support an estimate.

Classification42 codes

G06T 7/70
Image analysis: determining position or orientation of objects or cameras
G06F 3/14
Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for…: digital…
G06N 3/045
Architecture, e.g. interconnection topology: combinations of networks
G06N 3/0464
Architecture, e.g. interconnection topology: convolutional networks [CNN, ConvNet]

Family

Application62/542,077Us provisional application · filed 7 Aug 2017

Application15/847,796Parent of this continuation-in-part · filed 19 Dec 2017

Application15/907,112Parent of this continuation-in-part · filed 27 Feb 2018

Application15/945,473Parent of this continuation-in-part · filed 4 Apr 2018

US 10,055,853 B1Parent of this continuation-in-part · filed 21 Aug 2018

US 10,133,933 B1Parent of this continuation-in-part · filed 20 Nov 2018

Application16/255,573Parent of this continuation · filed 23 Jan 2019

US 10,474,988 B2Parent of this continuation-in-part · filed 12 Nov 2019

Application16/842,382Parent of this continuation · filed 7 Apr 2020

US 10,650,545 B2Parent of this continuation · filed 12 May 2020

US 2021/0350568 A1Pre-grant publication · published 11 Nov 2021

US 11,200,692 B2Parent of this continuation

Application16/255,573Parent of this continuation-in-part

US 2019/0043003 A1Published application

US 2019/0156506 A1Published application

US 2020/0234463 A1Published application

US 11,538,186 B2This patent

From the US filing history. Foreign family members aren’t listed.

Systems and methods to check-in shoppers in a cashier-less store

Life of this patent

Systems and methods to check-in shoppers in a cashier-less store

Life of this patent

Abstract

Claims20