# US 2019/0095736 A1 · Motion based account recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0095736 A1
- Document ID: US20190095736A1
- Status: Published application
- Kind: A1
- Application number: 15/719,463
- Filed: 2017-09-28
- Published: 2019-03-28
- Earliest claimed: 2017-09-28
- Assignees: Google Inc.
- Applicants: Google Inc.
- Inventors: Phillip Ellsworth Stahlfeld
- Web page: https://patentgrep.com/patent/US20190095736A1

## CPC

- G06V 40/70: Multimodal biometrics, e.g. combining information from different biometric modalities
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06Q 30/016: After-sales
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/166: {using acquisition arrangements}
- G06V 40/172: {Classification, e.g. identification}
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G06V 2201/10: Recognition assisted with metadata
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

A user establishes an account with an account management system and downloads a service application on a user computing device associated with the user. The user enters a service provider location and signs into a service application. A service camera device captures a video feed of one or more users within a visual field of the service camera device and a service computing device compares movement data received from user computing devices at the service provider location against movement of detected objects in the video feed to identify one or more users in the video feed. After identifying the one or more users within the video feed of the service camera device, in response to a particular user initiating a service request at the service computing device, the service computing device identifies the particular user at the service computing device as being within a service area of the video feed.

## Claims

### Claim 1

A computer-implemented method to identify users based on comparing movement data of user computing devices against changes of positions of detected objects in video feeds, comprising:
detecting, by a computing device, an object comprising an image of a user from a video feed in a first position;
determining, by the computing device, a change in a position of the detected object in the video feed over a time period from the first position to a second position;
receiving, by the computing device and from a user computing device, movement data indicating a movement of the user computing device over the time period;
determining, by the computing device, a correlation over the time period between changes in the change in the position of the detected object in the video feed from the first position to the second position with changes in the movement data received from the user computing device; and
based on the determined correlation, identifying, by the computing device, the detected object in the video feed as corresponding with the user computing device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the movement data comprises a gyroscopic signature and an accelerometer signature.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving, by the computing device, a request to initiate a service request; and
transmitting, by the computing device, a user computing device identifier corresponding to the identified user computing device and a request to process a service request to one or more computing devices.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining the change in the position of the detected object in the video feed comprises determining a movement signature of the detected object.

### Claim 5 (depends on 1)

The method of claim 1, wherein the movement data comprises a gyroscopic signature and an accelerometer signature, wherein determining the change in the position of the detected object in the video feed comprises determining a movement signature of the detected object, and wherein determining the correlation between the change in the position of the detected object in the video feed with the change in the movement data received from the user computing device comprises comparing the gyroscopic signature and the accelerometer signature against the movement signature.

### Claim 6 (depends on 2)

The method of claim 2, further comprising:
receiving, by the computing device and from the one or more computing devices, data corresponding to one or more accounts of the identified user;
displaying, by the computing device, at least some of the data corresponding to one or more accounts of the identified user;
receiving, by the computing device, an input of a selection of a particular account for use in the service request; and
transmitting, by the computing device and to the one or more computing devices, the selection of the particular account, wherein the one or more computing devices process the service request using the selected particular account.

### Claim 7 (depends on 1)

The method of claim 1, further comprising determining, by the computing device, that the second position of the detected object is within a defined area of the video feed comprising a service request area, wherein the request to process the service request is transmitted in response to determining that the second position of the detected object is within a service request area of the video feed.

### Claim 8 (depends on 1)

The method of claim 1, wherein the environment external to the computing device comprises the user located in a proximity to the computing device.

### Claim 9

A computer program product, comprising:
a non-transitory computer-readable medium having computer-readable program instructions embodied thereon that when executed by a computer cause the computer to identify users based on comparing movement data of user computing devices against changes of positions of detected objects in video feeds, the computer-readable program instructions comprising:
computer-readable program instructions to detect, within a video feed, an object comprising an image of a user from the video feed in a first position;
computer-readable program instructions to determine a change in a position of the detected object in the video feed over a time period from the first position to a second position;
computer-readable program instructions to receive, from a user computing device, movement data indicating a movement of the user computing device over the time period;
computer-readable program instructions to determine a correlation between changes, over the time period, in the position of the object in the video feed from the first position to the second position with changes in the movement data received from the user computing device; and
computer-readable program instructions to identify, based on the determined correlation, the object in the video feed as corresponding with the user computing device.

### Claim 10 (depends on 9)

The computer program product of claim 9, wherein the movement data comprises a gyroscopic signature and an accelerometer signature.

### Claim 11 (depends on 10)

The computer program product of claim 10, further comprising:
computer-readable program instructions to receive a request to initiate a service request; and
computer-readable program instructions to transmit a user computing device identifier corresponding to the identified user computing device and a request to process a service request to one or more computing devices.

### Claim 12 (depends on 10)

The computer program product of claim 10, wherein determining the change in position of the detected object in the video feed comprises determining a movement signature of the detected object, and wherein determining the correlation between the change in the position of the object in the video feed with the change in the movement data received from the user computing device comprises comparing the gyroscopic signature and the accelerometer signature against the movement signature.

### Claim 13 (depends on 9)

The computer program product of claim 9, further comprising computer-executable program instructions to determine that the second position of the detected object is within a defined area of the video feed comprising a service request area, wherein the request to process the service request is transmitted in response to determining that the second position of the detected object is within the service request area of the video feed.

### Claim 14

A system to identify users based on comparing movement data of user computing devices against changes of positions of detected objects in video feeds, comprising:
a storage device; and
a processor communicatively coupled to the storage device, wherein the processor executes application code instructions that are stored in the storage device to cause the system to:
detect, within a video feed, an object comprising an image of a user from the video feed in a first position;
determine a change in a position of the detected object in the video feed over a time period from the first position to a second position;
receive, from a user computing device, movement data indicating a movement of the user computing device over the time period;
determine a correlation between changes, over the time period, in the position of the object in the video feed from the first position to the second position with changes in the movement data received from the user computing device; and
based on the determined correlation, identify the object in the video feed as corresponding with the user computing device.

### Claim 15 (depends on 14)

The system of claim 14, wherein the movement data comprises a gyroscopic signature and an accelerometer signature.

### Claim 16 (depends on 14)

The system of claim 14, wherein the processor is further configured to execute computer-readable program instructions stored in the storage device to cause the system to:
receive a request to initiate a service request; and
transmit a user computing device identifier corresponding to the identified user computing device and a request to process a service request to one or more computing devices.

### Claim 17 (depends on 14)

The system of claim 14, wherein determining the change in position of the detected object in the video feed comprises determining a movement signature of the detected object.

### Claim 18 (depends on 14)

The system of claim 14, wherein the movement data comprises a gyroscopic signature and an accelerometer signature, wherein determining the change in position of the detected object in the video feed comprises determining a movement signature of the detected object, and wherein determining the correlation between the change in the position of the object in the video feed with the change in the movement data received from the user computing device comprises comparing the gyroscopic signature and the accelerometer signature against the movement signature.

### Claim 19 (depends on 14)

The system of claim 14, wherein the processor is further configured to execute computer-executable program instructions stored on the storage device to cause the system to:
receive, from the one or more computing devices, data corresponding to one or more accounts of the identified user;
display at least some of the data corresponding to one or more accounts of the identified user;
receive an input of a selection of a particular account for use in the service request; and
transmit, to the one or more computing devices, the selection of the particular account, wherein the one or more computing devise process the service request using the selected particular account.

### Claim 20 (depends on 14)

The system of claim 14, wherein the processor is further configured to execute computer-readable program instructions stored on the storage device to cause the system to determine that the second position of the detected object is within a defined area of the video feed comprising a service request area, wherein the request to process the service request is transmitted in response to determining that the second position of the detected object is within the service request area of the video feed.
