# US 11,899,767 B2 · Method and apparatus for multifactor authentication and authorization

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,899,767 B2
- Document ID: US11899767B2
- Status: Granted
- Kind: B2
- Application number: 17/868,252
- Filed: 2022-07-19
- Published: 2022-11-03
- Granted: 2024-02-13
- Earliest claimed: 2020-03-02
- Assignees: Charter Communications Operating, LLC
- Applicants: Charter Communications Operating, LLC
- Inventors: Wael Guibene; Hossam Hmimy
- Web page: https://patentgrep.com/patent/US11899767B2

## CPC

- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06F 21/35: communicating wirelessly
- G06F 40/295: Named entity recognition
- G06V 30/413: Classification of content, e.g. text, photographs or tables
- G06V 40/16: Human faces, e.g. facial parts, sketches or expressions
- G06V 40/172: {Classification, e.g. identification}
- G06V 40/45: {Detection of the body part being alive}
- H04L 63/0861: {using biometrical features, e.g. fingerprint, retina-scan (cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231)}
- H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
- G06F 2221/2141: Access rights, e.g. capability lists, access control lists, access tables, access matrices
- G06V 30/10: Character recognition
- H04L 2463/082: applying multi-factor authentication
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Methods and systems for multifactor authentication and authorization are described. A method includes receiving captured image data of a person with a badge needing access to a secure area, detecting at least two faces from the captured image data, identifying a first name based on matching a face associated with a live human face with a control face in a database, identifying a second name based on matching on another face associated with the badge with a control face in a database, performing character recognition on text associated with the another face, comparing the second name with the character recognized text, comparing the second name with the first name when the second name matches the character recognized text, checking access rights, checking for at least another person in a proximity of the secure area, and granting access when the person is sole person accessing the secure area.

## Claims

### Claim 1

A method for multifactor authentication and authorization, the method comprising:
detecting a live human face from image data of a person carrying a picture identification, the person needing security access;
identifying a name based on matching the live human face with a control face in a database;
identifying another name based on matching a face associated with the picture identification with a control face in the database;
performing character recognition on text present in the picture identification;
comparing the name, the another name, and the character recognized text for a match; and
checking access rights for a matched name.

### Claim 2 (depends on 1)

The method of claim 1, the method further comprising:
denying access when the face and the live human face are unassociated.

### Claim 3 (depends on 1)

The method of claim 1, the method further comprising:
denying access when the another name and the character recognized text do not match.

### Claim 4 (depends on 1)

The method of claim 1, the method further comprising:
denying access when at least one two of the name, the another name and the character recognized text do not match.

### Claim 5 (depends on 1)

The method of claim 1, the method further comprising:
determining if the live human face is live by tracking at least one of eye movements or eye blinks based on relationship between eye landmarks.

### Claim 6 (depends on 1)

The method of claim 1, the method further comprising:
denying access if the matched name has no access rights.

### Claim 7 (depends on 6)

The method of claim 6, the method further comprising:
denying access when multiple persons are detected in the proximity of the secure area.

### Claim 8 (depends on 7)

The method of claim 7, wherein the proximity of the secure area is a defined zone.

### Claim 9

A method for multifactor authentication and authorization, the method comprising:
receiving a video stream of an individual carrying a badge needing access to a controlled site;
performing, by comparing with identity data in a database, a first level authentication on a detected face determined to be a live human face;
performing, by comparing with the identity data in a database, a second level authentication on a detected face determined from the badge;
performing a third level authentication on character recognized text from the badge;
performing a fourth level authentication using outputs from the second level authentication and the third level authentication;
performing a fifth level authentication using outputs from the first level authentication and the fourth level authentication; and
granting access to the individual upon passing of the fifth level authentication.

### Claim 10 (depends on 9)

The method of claim 9, the method further comprising:
determining whether the face associated with the first level authentication is associated with the live human face; and
denying access when the face associated with the first level authentication is not associated with the live human face.

### Claim 11 (depends on 10)

The method of claim 10, wherein the determining further comprising:
tracking at least one of eye movements or eye blinks based on relationship between eye landmarks to determine if the detected face is a live human face.

### Claim 12 (depends on 9)

The method of claim 9, the method further comprising:
denying access when the first level authentication fails.

### Claim 13 (depends on 9)

The method of claim 9, the method further comprising:
denying access when the second level authentication fails.

### Claim 14 (depends on 9)

The method of claim 9, the method further comprising:
denying access when the third level authentication fails.

### Claim 15 (depends on 9)

The method of claim 9, the method further comprising:
denying access when the fourth level authentication fails.

### Claim 16 (depends on 9)

The method of claim 9, the method further comprising:
denying access when the fifth level authentication fails.

### Claim 17 (depends on 9)

The method of claim 9, the method further comprising:
denying access when the authorization review fails.

### Claim 18 (depends on 9)

The method of claim 9, the method further comprising:
denying access when multiple persons can access the controlled site with the individual's access grant.

### Claim 19

A multifactor authentication and authorization system comprising:
an access device proximate a restricted access area, the access device including at least a video camera;
a database configured to store identities; and
an access controller connected to the access device and the database, the access controller configured to:
receive a video stream from the access device;
detect a first face associated with a person and a second face associated with a badge carried by the person;
match the first face with a first identity from the database when the first face is a live human face;
match the second face with a second identity from the database;
match a character recognized name from the badge with the second identity;
match the first identity with the second identity when the character recognized name matches the second identity;
check access rights for a matched identity; and
grant access when the person has access rights to access the restricted access area.

### Claim 20 (depends on 19)

The system of claim 19, the access controller further configured to:
determine whether the first face is associated with the live human face by tracking at least one of eye movements or eye blinks based on geometry between eye landmarks; and
deny access when the first face is not associated with the live human face.
