# US 2020/0262931 A1 · Methods and apparatus for false positive minimization in facial recognition applications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0262931 A1
- Document ID: US20200262931A1
- Status: Published application
- Kind: A1
- Application number: 16/865,878
- Filed: 2020-05-04
- Published: 2020-08-20
- Earliest claimed: 2015-10-21
- Assignees: 15 Seconds of Fame, Inc.
- Applicants: 15 Seconds of Fame, Inc.
- Inventors: Adam RESNICK; Ruslan SABITOV; Brett JOSHPE
- Web page: https://patentgrep.com/patent/US20200262931A1

## CPC

- C07K 16/40: against enzymes
- A61K 39/39591: {Stabilisation, fragmentation}
- A61K 47/26: Carbohydrates, e.g. sugar alcohols, amino sugars, nucleic acids, mono-, di- or oligo-saccharides; Derivatives thereof, e.g. polysorbates, sorbitan fatty acid esters or glycyrrhizin
- C07K 16/18: against material from animals or humans
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06V 20/49: {Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes}
- G06V 40/172: {Classification, e.g. identification}
- G06V 2201/10: Recognition assisted with metadata
- C07K: PEPTIDES (peptides in foodstuffs A23; obtaining protein compositions for foodstuffs, working-up proteins for foodstuffs A23J; preparations for medicinal purposes A61K; peptides containing beta-lactam rings C07D; cyclic dipeptides not having in their molecule any other peptide link than those which form their ring, e.g. piperazine-2,5-diones, C07D; ergot alkaloids of the cyclic peptide type C07D519/02; macromolecular compounds having statistically distributed amino acid units in their molecules, i.e. when the preparation does not provide for a specific; but for a random sequence of the amino acid units, homopolyamides and block copolyamides derived from amino acids C08G69/00; macromolecular products derived from proteins C08H1/00; preparation of glue or gelatine C09H; single cell proteins, enzymes C12N; genetic engineering processes for obtaining peptides C12N15/00; compositions for measuring or testing processes involving enzymes C12Q; investigation or analysis of biological material G01N33/00)
- A61K: PREPARATIONS FOR MEDICAL, DENTAL OR TOILETRY PURPOSES (devices or methods specially adapted for bringing pharmaceutical products into particular physical or administering forms A61J3/00; chemical aspects of, or use of materials for deodorisation of air, for disinfection or sterilisation, or for bandages, dressings, absorbent pads or surgical articles A61L; soap compositions C11D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An apparatus can include a processor that can receive location data from a user device, and store the location data in a user profile data structure also storing facial recognition data. The processor can also receive at least one image, and can identify a location based at least in part on a set of characteristics within the at least one image. The processor can, for each user profile data structure stored in a database, compare location data in that user profile data structure to the location. The processor can, when the location data of the user profile data structure and the location match, conduct facial recognition to determine whether the user associated with the user profile data structure can be identified in the at least one image. The processor can then associate the at least one image with the user profile data structure if the user can be identified.

## Claims

### Claim 1

An apparatus, comprising:
a memory; and
a processor in communication with the memory, the processor configured to receive data from a user device and save the data in a user profile data structure stored in a database, the user profile data structure including facial recognition data of a user associated with the user device,
the processor configured to (1) receive at least one image from an image capture device, (2) identify a venue based at least in part on data associated with the at least one image and an image location within the venue based at least in part on image characteristics within the at least one image, and (3) determine whether the user is at the venue based on data stored in the user profile data structure,
when the user is determined to be at the venue, the processor configured to (1) perform facial recognition analysis on the at least one image with respect to the facial recognition data of the user to identify a facial recognition confidence score associated with the user, (2) determine a user location within the venue based on data stored in the user profile data structure, (3) increase the facial recognition confidence score when the user location within the venue and the image location are within a predetermined distance of each other, and (4) associate the at least one image with the user profile data structure when the facial recognition confidence score meets a predetermined criterion, and
when the user is determined to not be at the venue, the processor configured to not perform facial recognition analysis on the at least one image with respect to the facial recognition data of the user.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the data received from the user device is at least one of iBeacon data, Global Positioning Service (GPS) data, a seat identifier, social media data, internet web browsing data, purchase data, near field communication (NFC) verification data, cellular network triangulation data, or a Wi-Fi network identifier.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the user is a first user, the image capture device is at least one of a manually operated camera associated with the venue, an autonomous camera associated with the venue, or a camera of a user device associated with a second user different from the first user.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the processor is configured to identify the image location by:
performing image processing on the at least one image;
identifying at least one venue landmark based on the image processing; and
identifying the image location by determining a location of the venue landmark.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the facial recognition data of the user includes data relating to at least one photograph of the user that is stored in the user profile data structure.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the at least one image is stored in the database if the facial recognition confidence score associated with the user meets the predetermined criterion.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the processor is configured to automatically send to the user device the at least one image when the facial recognition confidence score meets the predetermined criterion.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the processor is configured to determine the user location within the venue by inferring a section within the venue based on data stored in the user profile data structure.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the data stored in the user profile data structure includes location data, the processor is configured to determine the user is at the venue based on the location data stored in the user profile data structure.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the data stored in the user profile data structure includes historical location data associated with the user device, the processor is configured to determine the user is at the venue based on the historical location data stored in the user profile data structure.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the data stored in the user profile data structure includes location data and non-location data, the processor is configured to determine the user is at the venue based on the location data and configured to determine the user location within the venue based on the non-location data.

### Claim 12

A method, comprising:
storing data received from a user device in a user profile data structure;
receiving at least one image from an image capture device;
identifying (1) a venue based at least in part on data associated with the at least one image and (2) an image location within the venue based at least in part on image characteristics within the at least one image;
determining a user is at the venue based on data stored in the user profile data structure;
determining a user location within the venue based on data stored in the user profile data structure, at least a portion of the data used to determine the user location within the venue being different from the data used to determine the user at the venue;
performing facial recognition analysis on the at least one image with respect to facial recognition data within the user profile data structure if the user location is within a predetermined distance of the image location and not performing the facial recognition analysis if the distance is greater than the predetermined distance, and
associating the at least one image with the user profile data structure when the at least one image matches the facial recognition data.

### Claim 13 (depends on 12)

The method of claim 12, wherein the data received from the user device is at least one of iBeacon data, Global Positioning Service (GPS) data, a seat number, social media data, internet web browsing data, purchase data, near field communication (NFC) verification data, cellular network triangulation data, or a Wi-Fi network identifier.

### Claim 14 (depends on 12)

The method of claim 12, further comprising:
pre-processing the at least one image to determine contextual information before the performing facial recognition analysis on the at least one image,
the contextual information including at least one of an identifier associated with the venue, a time the at least one image was captured, or a coinciding event that occurred when the at least one image was captured.

### Claim 15 (depends on 12)

The method of claim 12, further comprising:
calculating a confidence level associated with the user based on the performing facial recognition analysis on the at least one image with respect to the facial recognition data; and
determining that the facial recognition data associated with the user matches a likeness of the user in the at least one image when the confidence level exceeds a predetermined threshold.

### Claim 16 (depends on 12)

The method of claim 12, wherein the at least one image is a video including the at least one image, the method further comprising:
dividing the video into a series of images, the performing facial recognition analysis on the at least one image includes performing facial recognition analysis on each image in the series of images with respect to the facial recognition data.

### Claim 17 (depends on 12)

The method of claim 12, further comprising:
sending a signal indicative of an instruction to graphically render the at least one image at the user device when the at least one image matches the facial recognition data.

### Claim 18 (depends on 12)

The method of claim 12, wherein the identifying of the image location includes identifying the image location based at least in part on background scenery or a background landmark included in the at least one image.

### Claim 19 (depends on 12)

The method of claim 12, wherein the user profile data structure is from a plurality of user profile data structures stored in the database, each user profile data structure from the plurality of user profile data structures including facial recognition data of a corresponding user, the method further comprising:
discarding the at least one image if the at least one image does not match facial recognition data of at least one user profile data structure from the plurality of user profile data structures.

### Claim 20 (depends on 12)

The method of claim 12, further comprising:
sending, automatically and to the user device, the at least one image when the at least one image matches the facial recognition data.

### Claim 21 (depends on 12)

The method of claim 12, wherein the determining the user location within the venue includes inferring a section within the venue based on the second portion of the data.

### Claim 22 (depends on 12)

The method of claim 12, wherein the data stored in the user profile data structure includes location data, the determining the user is at the venue includes determining the user is at the venue based on the location data.

### Claim 23 (depends on 12)

The method of claim 12, wherein the data stored in the user profile data structure includes location data and non-location data, the determining the user is at the venue includes determining the user is at the venue based on the location data and the determining the user location within the venue includes determining the user location within the venue based on the non-location data.
