# US 10,484,818 B1 · Systems and methods for providing location information about registered user based on facial recognition

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,484,818 B1
- Document ID: US10484818B1
- Status: Granted
- Kind: B1
- Application number: 16/142,435
- Filed: 2018-09-26
- Granted: 2019-11-19
- Earliest claimed: 2018-09-26
- Applicants: Maris Jacob Ensing
- Inventors: Maris Jacob Ensing
- Web page: https://patentgrep.com/patent/US10484818B1

## CPC

- H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
- G06V 20/53: {Recognition of crowd images, e.g. recognition of crowd congestion}
- G06V 40/172: {Classification, e.g. identification}
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04W 4/02: Services making use of location information
- H04W 4/029: Location-based management or tracking services
- H04W 4/08: User group management
- H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods for providing location information for registered users in a venue. A facial recognition process is used to identify each registered user, and associate each identified registered user with a location of the image from which the identification was made. The location information may then be provided when an authorized user requests the location information for a particular registered user.

## Claims

### Claim 1

A system for providing location information of registered users in a venue using image processing, comprising:
a plurality of image capture devices, wherein each of the plurality of image capture devices is aimed at one of a plurality of locations in a venue to capture an image of the location;
one or more processors; and
memory in data communication with each of the one or more processors and that stores instructions that, when read by the one or more processors, direct the one or more processors to:
receive a plurality of captured images from the plurality of image capture devices, wherein each of the plurality of captured images is captured at one of the plurality of locations and is captured by one of the plurality of image capture devices;
perform processing to identify visual identifiers saved in a register record to determine each registered user identified in each of the plurality of captured images;
associate each registered user identified in each of the plurality of captured images with the location of the image in which each registered user is identified;
store the location of each of the registered users in location information of a data record maintained for each of the registered users;
receive a request for the location information of a particular registered user;
provide the location information in the data record of the particular registered user to satisfy the request;
determine a crowd size for a particular location based on the plurality of images;
compare the crowd size of the particular location to a threshold for crowd capacity of the particular location;
generate a notification of crowd size for the particular location; and
transmit the notification to a set of registered users interested in the particular location.

### Claim 2 (depends on 1)

The system of claim 1, wherein the image processing performed comprises facial recognition, and wherein a visual identifier of a registered user comprises a face of the registered user.

### Claim 3 (depends on 1)

The system of claim 1, further comprising:
a proximity sensor operable to detect a patron of the venue in a location, and to transmit a proximity signal in response to the detection, wherein at least one of the plurality of image capture devices associated with the location obtains an image of the location in response to receipt of the proximity signal.

### Claim 4 (depends on 1)

The system of claim 1, wherein at least one of the plurality of image capture devices includes a proximity sensor operable to detect a patron of the venue in a location, and to transmit a proximity signal in response to the detection, wherein the at least one of the plurality of image capture devices associated with the location obtains an image of the location in response to receipt of the proximity signal.

### Claim 5 (depends on 2)

The system of claim 2, wherein the instructions to perform facial recognition on the plurality of captured images include instructions to:
identify each portion in each of the plurality of captured images that includes a facial image; and
perform facial recognition on each portion of each of the plurality of captured images that includes a facial image to determine whether a registered user is associated with the facial image.

### Claim 6 (depends on 5)

The system of claim 5, wherein the instructions to perform facial recognition on the plurality of captured images include instructions to:
obtain an identifier of each registered user associated with a portion in each of the plurality of captured images; and
add the identifier and associated location to current location information.

### Claim 7 (depends on 1)

The system of claim 1, wherein the instructions further include instructions to:
receive a consumable transaction for a particular registered user wherein the request includes an identifier of consumable product obtained by the particular registered user and an identifier of the particular registered user; and
add the consumable product to consumable products that the particular registered user has obtained in the data record of the particular registered user.

### Claim 8 (depends on 7)

The system of claim 7, wherein the instructions further include instructions to:
receive a request for consumable products of the particular registered user from a redemption center system;
provide each consumable product stored in the data record of the particular registered user;
receive a list of redeemed consumable products for the particular registered user from the redemption center system; and
update the data record of the particular registered user to remove consumable products on the list of redeemed consumable products.

### Claim 9 (depends on 1)

The system of claim 1, wherein the instructions further include instructions to:
determine an identified registered user in one of a plurality of locations;
determine whether the identified registered user has a restriction requirement associated with the one of the plurality of locations;
determine whether the restriction requirement is met for the identified registered user in response to determining the identified registered user has the restriction requirement; and
generate a notification in response to a determination that the restriction requirement is not met.

### Claim 10 (depends on 1)

The system of claim 1, wherein the instructions further include instructions to:
capture an image of a registered user at a photo opportunity area;
associate the registered user with the image from the photo opportunity area;
receive a request for each image from photo opportunity area associated with the registered user; and
provide the image from the photo opportunity area in response to the request.

### Claim 11 (depends on 1)

The system of claim 1, wherein the request is a request for location information for a group of registered users that includes the particular registered user, and wherein the location information for each registered user in the group is provided to satisfy the request.

### Claim 12

A method for providing location information for registered users at a venue, the method comprising:
capturing a plurality of images using a plurality of image capture devices, wherein each of the plurality of images is captured in of one of the different locations and is captured by one of the plurality of image capture devices;
performing image processing on each of the plurality of images to determine each visual identifier associated with a register record of one of a plurality of registered users identified in each of the plurality of captured images;
associating each of the plurality of registered users identified in each of the plurality of captured images with a location of the image in which each registered user is identified;
storing the location of each of the plurality of identified registered users in location information of a data record maintained for each of the plurality of identified registered users in a central control system;
receiving a request for location information of a particular registered user in the central control system from a requesting system;
providing the location information in the data record of the particular registered user to satisfy the request from the central control system;
determining a crowd size for a particular location based on the plurality of images;
comparing the crowd size of the particular location to a threshold for crowd capacity of the particular location;
generating a notification of crowd size for the particular location; and
transmitting the notification to a set of registered users interested in the particular location.

### Claim 13 (depends on 12)

The method of claim 12, wherein the image processing system is a facial recognition system and the visual identifier is a face, and wherein the step of performing image processing includes performing facial recognition to identify a face of each registered user in each of the plurality of images.

### Claim 14 (depends on 12)

The method of claim 12, further comprising:
detecting a patron of the venue in a location using a proximity sensor; and transmitting a proximity signal from the proximity sensor to one of the plurality of image capture devices associated with the location in response to the detection, wherein the one of the plurality of image capture devices associated with the location captures an image of the location in response to the proximity signal.

### Claim 15 (depends on 12)

The method of claim 12, further comprising:
obtaining an identifier of each registered user associated with a portion in each of the plurality of captured images using the image processing system; and
adding the identifier and an associated location to current location information using the image processing system.

### Claim 16 (depends on 12)

The method of claim 12, further comprising:
receiving a consumable transaction for a particular registered user wherein the request includes an identifier of a consumable product obtained by the particular registered user and an identifier of the particular registered user in the central control system; and
adding the consumable product transaction to consumable products that the particular registered user has obtained in the data record of the particular registered user using the central control system.

### Claim 17 (depends on 14)

The method of claim 14, further comprising:
receiving a request for consumable products of the particular registered user from a redemption center system in the central control system;
providing each consumable product stored in the data record of the particular registered user from the central control system to the redemption center system;
receiving a list of redeemed consumable products for the particular registered user from the redemption center system in the central control system;
updating the data record of the particular registered user to remove consumable products on the list of redeemed consumable products using the central control system.

### Claim 18 (depends on 12)

The method of claim 12, wherein one of the plurality of captured images is an image of a particular location, and wherein the method further comprises:
determining an identified registered user in the image of the particular location using the central control system;
determining whether the identified registered user has a restriction requirement associated with the particular location using the central control system;
determining whether the restriction requirement is met for the identified registered user in response to determining the identified registered user has the restriction requirement using the central control system; and
generating a notification in response to a determination that the restriction requirement is not met using the central control system.

### Claim 19 (depends on 12)

The method of claim 12, wherein the request is a request for location information for a group of registered users that includes the particular registered user, and wherein the location information for each registered user in the group is provided to satisfy the request.

### Claim 20 (depends on 12)

The method of claim 12, further comprising:
capturing an image of a register user at a photo opportunity area using an image capture device associated with the photo opportunity area;
associating the registered user with the image from the photo opportunity area using a location control system;
receiving a request for each image from photo opportunity area associated with the registered user from a redemption system in the central control system; and
providing the image from the photo opportunity area in response to the request.

### Claim 21

Apparatus for providing location information for a registered user in a venue, the apparatus comprising:
a processor; and
memory readable by the processor that stores instructions that, when read by the processor, directs the processor to:
capture a plurality of images using a plurality of image capture devices, wherein each of the plurality of images is of one of a plurality of different locations and is captured by one of a plurality of image capture devices;
perform image processing on each of the plurality of images to determine visual identifiers of registered users identified in each of the plurality of captured images;
associate each registered user identified in each of the plurality of captured images with the location of the image in which each registered user is identified;
store the location in of each of the identified registered users in location information of a data record maintained for each of the identified registered users;
receive a request for location information of a particular registered user;
provide the location information in the data record of the particular registered user to satisfy the request;
determine a crowd size for a particular location based on the plurality of images;
compare the crowd size of the particular location to a threshold for crowd capacity of the particular location;
generate a notification of crowd size for the particular location; and
transmit the notification to a set of registered users interested in the particular location.