US 11,057,751 B1Granted

User identification system using directional antennas and cameras

AssigneeAmazon Technologies, Inc.

InventorsSomasundaram Niranjayan, Camerin Cole Hahn, Christopher Raymond Grajewski, Qicai Shi, Matthew Perkins

Life of this patent

Estimating the term…

Loading patent…

Abstract

A facility may include antennas directed to a known location and cameras with a field-of-view that encompasses the known location. The antennas acquire a device identifier and device data from a mobile device carried by a user at the known location. Antenna data is then generated to describe the data acquired by the antennas. Image data is also generated from the cameras to include images of a person at the known location. The antenna data and image data are then processed to determine estimated motion values and a comparison of such values is performed to check if such motion values are within a threshold of one another. If the motion values are within a threshold of each other, data indicative of presence of the mobile device at the known location is generated.

Claims20

Dependent claims

A system comprising:

a first antenna directed to a volume in a facility;
a second antenna directed to the volume in the facility;
at least one receiver, connected to one or more of the first and second antennas;
a first memory storing first computer-executable instructions;
a first hardware processor to execute the first computer-executable instructions to:
generate first data indicative of:
a received signal strength of one or more signals received by the at least one receiver, and
a device identifier for a mobile device;
a camera that generates second data, wherein the camera has a field-of-view that encompasses the at least a portion of the volume in the facility;
and
a server comprising:
a network interface;
a second memory storing second computer-executable instructions;
and
a second hardware processor configured to execute the second computer-executable instructions to:
receive the first data using the network interface;
determine an estimated motion value of the mobile device based on the first data, wherein the estimated motion value is indicative of a direction of motion and a speed during a first interval of time;
determine, using the device identifier, an account associated with the mobile device;
receive device data from the mobile device using the network interface, wherein the device data comprises information gathered by one or more sensors associated with the mobile device;
determine an inertial motion value of the mobile device based on the device data;
compare the estimated motion value of the mobile device, the inertial motion value of the mobile device, and a first threshold value;
receive the second data using the network interface;
determine one or more values based on the second data;
determine the one or more values are within a second threshold value of one or more of the estimated motion value of the mobile device or the inertial motion value of the mobile device;
and
generate third data indicative of presence of a person associated with the account within the volume in the facility.

23 more elements

A system comprising:

one or more antennas directed to a volume in a facility;
at least one receiver connected to the one or more antennas;
a first memory storing first computer-executable instructions;
a first hardware processor configured to execute the first computer-executable instructions to:
generate first data based on one or more signals received by the at least one receiver;
a camera with a field-of-view encompassing at least a portion of the volume in the facility;
and
a server comprising:
a second memory storing second computer-executable instructions;
and
a second hardware processor configured to execute the second computer-executable instructions to:
access the first data;
determine an estimated motion value of a mobile device based on the first data;
access second data received from the mobile device;
determine an inertial motion value of the mobile device based on the second data;
access third data from the camera;
determine one or more values from the third data;
compare the one or more values to one or more of the estimated motion value of the mobile device or the inertial motion value of the mobile device;
determine identification data associated with the mobile device;
determine an account associated with the identification data;
and
generate fourth data indicative of presence of the mobile device associated with the account within the volume in the facility.

19 more elements

A method comprising:

accessing first data associated with a mobile device, wherein:
the first data is based on one or more signals received by at least one receiver;
and
the at least one receiver is connected to one or more antennas directed to a volume in a facility;
determining an estimated motion value of a mobile device based on the first data;
accessing second data received from the mobile device, the second data indicative of information from one or more sensors associated with the mobile device;
determining an inertial motion value of the mobile device based on the second data;
comparing the estimated motion value of the mobile device and the inertial motion value of the mobile device;
accessing third data acquired by a camera with a field-of-view encompassing at least a portion of the volume in the facility;
determining one or more values from the third data;
comparing the one or more values to one or more of the estimated motion value of the mobile device or the inertial motion value of the mobile device;
determining identification data associated with the mobile device;
determining an account associated with the identification data;
and
generating fourth data indicative of presence of a person associated with the account within the volume in the facility.

12 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/362,378Filed 22 Mar 2019 · continuation
Priority: 28 Dec 2015
Granted: 6 Jul 2021
Term ends: Not estimatedThe source records don’t support an estimate.

Classification11 codes

H04W 4/33
Services specially adapted for particular environments, situations or purposes: for indoor environments, e.g. buildings
G06Q 30/06
Commerce: buying, selling or leasing transactions
G06V 40/172
Human faces, e.g. facial parts, sketches or expressions: classification, e.g. identification
G08B 13/19608
Image analysis to detect motion of the intruder, e.g. by frame subtraction: tracking movement of a target, e.g. by detecting an object predefined…