# US 2020/0005319 A1 · System to determine group association between users

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0005319 A1
- Document ID: US20200005319A1
- Status: Published application
- Kind: A1
- Application number: 16/023,748
- Filed: 2018-06-29
- Published: 2020-01-02
- Earliest claimed: 2018-06-29
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: BENJAMIN CHARLES SCARBOROUGH; GARETH UJVAROSY; VINODH MUTHIAH; MAXWELL AARON CORMAN; SALVADOR BEDREDIN MEDINA MAZA
- Web page: https://patentgrep.com/patent/US20200005319A1

## CPC

- G06Q 10/00: Administration; Management
- G06Q 20/40145: {Biometric identity checks}
- G06Q 10/08: Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q 10/0833: Tracking
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G07C 9/37: using biometric data, e.g. fingerprints, iris scans or voice recognition
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE

## Abstract

A facility may allow an authorized user to sponsor other users to enter. Actions taken by those users may be associated with the account of the authorized user. Sensor data obtained at a portal may be indicative of whether a user attempted to provide credentials to a sensor at the portal, time between entry of users, attributes about the user, and so forth. Information about when the users have exited may also be obtained. For example, if three people entered one after another and then left at the same time, they may be deemed to form a group. Based on this information, the actions taken by the users in the group may be associated with the account of the authorized user.

## Claims

### Claim 1

A system comprising:
a gate at a facility comprising:
a first pedestal on a first side and a second pedestal on a second side that form a passage in between;
a first camera at the second pedestal, wherein the first camera has a field of view directed upward;
a second camera having a second field of view that includes at least a portion of the gate and the passage; and
a first computing device to:
determine, based on image data from the first camera, a first user presented identification data at the gate;
determine that a second user did not present identification data;
determine, based on image data from the second camera, a first entry time of the first user to the facility and a second entry time of the second user to the facility;
determine a first difference between the first entry time and the second entry time is less than a first threshold;
determine, based on the image data from the second camera, a first exit time of the first user from the facility and a second exit time of the second user from the facility;
determine a second difference between the first exit time and the second exit time is less than a second threshold;
determine group data indicative of the first user being associated with the second user;
receive data that indicates the second user took an item from the facility; and
determine a charge for the item to an account associated with the first user.

### Claim 2 (depends on 1)

The system of claim 1, further comprising a third camera having a third field of view in the facility;
the first computing device to:
determine, based on image data from the third camera, that the first user and the second user are within a threshold distance of one another for at least a first duration; and
wherein the group data is based at least in part on the first user and the second user being within the threshold distance of one another for at least the first duration.

### Claim 3

A computer implemented method comprising:
determining an entry anomaly at a first entry location to a facility at a first time;
determining, within a first threshold time of the first time, presence of a first user at the first entry location;
determining, within a second threshold time of the first time, presence of a second user at the first entry location;
determining first data presented at the first entry location at the first time;
determining a first account associated with the first data, wherein the first account is associated with the first user; and
determining the second user is associated with the first account.

### Claim 4 (depends on 3)

The method of claim 3, the determining the entry anomaly comprising one or more of:
determining the second user did not perform a scan gesture,
determining the second user passed through the first entry location within a third threshold time of the first user, or
determining a count of data presented at the first entry location within a fourth threshold time of the first time differs from a count of a number of people detected at the first entry location.

### Claim 5 (depends on 3)

The method of claim 3, the determining the entry anomaly comprising:
acquiring a plurality of images of the first entry location;
determining, based on the plurality of images, that a hand of the second user was not within a specified region that is proximate to a scanner at the first entry location while the second user was at the first entry location.

### Claim 6 (depends on 3)

The method of claim 3, the determining the second user is associated with the first account comprising:
determining a first exit time of the first user from the facility at a first exit;
determining a second exit time of the second user from the facility at the first exit; and
determining a second difference between the first exit time and the second exit time is less than a second threshold.

### Claim 7 (depends on 3)

The method of claim 3, the determining the second user is associated with the first account comprising determining that the first user interacted with the second user within the facility.

### Claim 8 (depends on 7)

The method of claim 7, the determining the first user interacted with the second user further comprising one or more of:
determining the first user and the second user are within a first threshold distance of one another within the facility for at least a first duration,
determining a transfer of an object between the first user and the second user, or
determining the first user and the second user are within a second threshold distance and face each other a threshold number of times.

### Claim 9 (depends on 3)

The method of claim 3, the determining the second user is associated with the first account comprising:
determining a first gesture by the first user at the first entry location, wherein the first gesture is associated with presentation of the first data by the first user; and
determining an absence of a second gesture by the second user to present data at the first entry location.

### Claim 10 (depends on 3)

The method of claim 3, the determining the second user is associated with the first account comprising:
determining a height of the second user; and
determining the height is less than a threshold height.

### Claim 11 (depends on 3)

The method of claim 3, the determining the second user is associated with the first account comprising:
determining that historical data indicates the first account has previously been associated with another user at the facility.

### Claim 12 (depends on 3)

The method of claim 3, the determining the second user is associated with the first account comprising:
determining a first entry time of the first user to the facility at the first entry location;
determining a second entry time of the second user to the facility at the first entry location;
determining a third entry time of a third user to the facility at the first entry location, wherein the third entry time is before the first entry time or after the second entry time;
determining second data presented by the third user at the first entry location; and
disqualifying the third user from being associated with the first account.

### Claim 13 (depends on 3)

The method of claim 3, the determining the second user is associated with the first account comprising:
determining a first entry time of the first user to the facility at the first entry location;
determining a second entry time of the second user to the facility at the first entry location; and
determining a first difference between the first entry time and the second entry time is less than a first threshold and greater than a second threshold.

### Claim 14

A computer implemented method comprising:
obtaining data from one or more sensors at a facility;
determining, based at least in part on the data, an entry anomaly to the facility at an entry location at a first time;
determining, based at least in part on the data, a first user and a second user associated with the first time; and
determining, based at least in part on the data, the second user is associated with a first account that is associated with the first user.

### Claim 15 (depends on 14)

The method of claim 14, the determining the entry anomaly comprising one or more of:
determining the second user did not perform a scan gesture,
determining the second user passed through the entry location within a threshold time of the first user,
determining the second user entered the facility while a gate at the entry location was closed,
determining a count of data presented at the entry location at the first time differs from a count of a number of people detected at the entry location, or
determining presence of the second user inside the facility without data indicative of the second user passing through the entry location.

### Claim 16 (depends on 14)

The method of claim 14, the determining, based at least in part on the data, the second user is associated with the first account comprising:
determining a first entry time of the first user to the facility at the entry location;
determining a second entry time of a second user to the facility at the entry location;
determining a first difference between the first entry time and the second entry time is less than a first threshold;
determining a first exit time of the first user from the facility at a first exit;
determining a second exit time of the second user from the facility at the first exit; and
determining a second difference between the first exit time and the second exit time is less than a second threshold.

### Claim 17 (depends on 14)

The method of claim 14, the determining the second user is associated with the first account comprising one or more of:
determining the first user and the second user are within a first threshold distance of one another within the facility for at least a first duration,
determining a transfer of an object between the first user and the second user, or
determining the first user and the second user are within a second threshold distance and face each other a threshold number of times.

### Claim 18 (depends on 14)

The method of claim 14, the determining the second user is associated with the first account comprising:
determining a first gesture by the first user at the entry location, wherein the first gesture is associated with presentation of data by the first user; and
determining an absence of the first gesture by the second user at the entry location.

### Claim 19 (depends on 14)

The method of claim 14, the determining the second user is associated with the first account comprising:
determining a height of the second user; and
determining the height is less than a threshold height.

### Claim 20 (depends on 14)

The method of claim 14, the determining the second user is associated with the first account comprising:
determining a first entry time of the first user to the facility at the entry location;
determining first data presented by the first user at the entry location;
determining a second entry time of the second user to the facility at the entry location;
determining that the second user did not present data at the entry location;
determining a third entry time of a third user to the facility at the entry location, wherein the third entry time is before the first entry time or after the second entry time;
determining second data presented by the third user at the entry location; and
disqualifying the third user from being associated with the first account.

### Claim 21 (depends on 14)

The method of claim 14, further comprising:
determining the second user took an item from the facility; and
determining a charge for the item to the first account.
