# US 2021/0334351 A1 · Passive affective and knowledge-based authentication through eye movement tracking

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0334351 A1
- Document ID: US20210334351A1
- Status: Published application
- Kind: A1
- Application number: 17/367,149
- Filed: 2021-07-02
- Published: 2021-10-28
- Earliest claimed: 2018-10-08
- Assignees: Advanced New Technologies Co., Ltd.
- Applicants: Advanced New Technologies Co., Ltd.
- Inventors: Reza R. Derakhshani; Sashi Kanth Saripalle
- Web page: https://patentgrep.com/patent/US20210334351A1

## CPC

- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 18/2148: {characterised by the process organisation or structure, e.g. boosting cascade}
- G06V 40/18: Eye characteristics, e.g. of the iris
- H04L 63/0861: {using biometrical features, e.g. fingerprint, retina-scan (cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231)}
- H04L 63/10: {for controlling access to devices or network resources}
- G06F 21/36: by graphic or iconic representation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for authenticating a user based on passive affective and knowledge-based authentication (AKBA). In one aspect, a method includes data associated with eye movements and ocular dynamics of the user are captured with a camera as the user looks at a graphical user interface (GUI) of a device; an AKBA signature of the user is determined based on the captured data; the user is authenticated based on a comparison of the AKBA signature with an AKBA template associated with the user; and an access to a subset of functions of an application is granted.

## Claims

### Claim at position 1

-20. (canceled)

### Claim 21

A computer-implemented method for authenticating a user based on passive affective and knowledge-based authentication (AKBA), the method being executed by one or more processors and comprising:
capturing, with a camera, data associated with eye movements and ocular dynamics of the user as the user looks at a graphical user interface (GUI) of a device, wherein a stimulus displayed on the GUI comprises at least one first image relating to at least one of positive preferences, negative preferences, or biographical experiences of the user;
determining an AKBA signature of the user based on the captured data;
authenticating the user based on a comparison of the AKBA signature with an AKBA template associated with the user, wherein the AKBA template is pregenerated based on the user's eye movements and ocular dynamics in response to a preprogrammed visual stimulus comprising at least one second image relating to at least one of the positive preferences, the negative preferences, or the biographical experiences; and
granting access to a subset of functions of an application in response to authenticating the user based on the comparison of the AKBA signature with the AKBA template.

### Claim 22 (depends on 21)

The computer-implemented method of claim 21, wherein the stimulus displayed on the GUI is configured to gauge true memories of the user.

### Claim 23 (depends on 21)

The computer-implemented method of claim 21, wherein authenticating the user comprises:
generating a similarity score based on the comparison of the AKBA signature with the AKBA template; and
authenticating the user based on the similarity score, wherein the user is authenticated when the similarity score is within a range of a predetermined threshold.

### Claim 24 (depends on 23)

The computer-implemented method of claim 23, wherein generating the similarity score comprises:
determining a plurality of first scores, wherein each first score is determined based on a comparison of a measurement of a respective feature comprised in the AKBA template and a measurement of a corresponding same feature comprised in the AKBA signature;
determining a respective weight for each of the first scores; and
combining the first scores weighted by their respective weights to determine the similarity score.

### Claim 25 (depends on 21)

The computer-implemented method of claim 21, wherein the AKBA template of the user is pregenerated during an enrollment process.

### Claim 26 (depends on 25)

The computer-implemented method of claim 25, comprising pregenerating the AKBA template of the user during the enrollment process, wherein pregenerating the AKBA template comprises:
querying the user about at least one of the positive preferences, negative preferences, or biographical experiences;
displaying the preprogrammed visual stimulus comprising the at least one second image; and
capturing, with a second camera or with the camera, template data associated with eye movements and ocular dynamics of the user as the user looks at the preprogrammed visual stimulus.

### Claim 27

A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations for authenticating a user based on passive affective and knowledge-based authentication (AKBA) comprising:
capturing, with a camera, data associated with eye movements and ocular dynamics of the user as the user looks at a graphical user interface (GUI) of a device, wherein a stimulus displayed on the GUI comprises at least one first image relating to at least one of positive preferences, negative preferences, or biographical experiences of the user;
determining an AKBA signature of the user based on the captured data;
authenticating the user based on a comparison of the AKBA signature with an AKBA template associated with the user, wherein the AKBA template is pregenerated based on the user's eye movements and ocular dynamics in response to a preprogrammed visual stimulus comprising at least one second image relating to at least one of the positive preferences, the negative preferences, or the biographical experiences; and
granting access to a subset of functions of an application in response to authenticating the user based on the comparison of the AKBA signature with the AKBA template.

### Claim 28 (depends on 27)

The non-transitory, computer-readable medium of claim 27, wherein the stimulus displayed on the GUI is configured to gauge true memories of the user.

### Claim 29 (depends on 27)

The non-transitory, computer-readable medium of claim 27, wherein authenticating the user comprises:
generating a similarity score based on the comparison of the AKBA signature with the AKBA template; and
authenticating the user based on the similarity score, wherein the user is authenticated when the similarity score is within a range of a predetermined threshold.

### Claim 30 (depends on 29)

The non-transitory, computer-readable medium of claim 29, wherein generating the similarity score comprises:
determining a plurality of first scores, wherein each first score is determined based on a comparison of a measurement of a respective feature comprised in the AKBA template and a measurement of a corresponding same feature comprised in the AKBA signature;
determining a respective weight for each of the first scores; and
combining the first scores weighted by their respective weights to determine the similarity score.

### Claim 31 (depends on 27)

The non-transitory, computer-readable medium of claim 27, wherein the AKBA template of the user is pregenerated during an enrollment process.

### Claim 32 (depends on 31)

The non-transitory, computer-readable medium of claim 31, wherein the operations comprise pregenerating the AKBA template of the user during the enrollment process, and wherein pregenerating the AKBA comprises:
querying the user about at least one of the positive preferences, negative preferences, or biographical experiences;
displaying the preprogrammed visual stimulus comprising the at least one second image; and
capturing, with a second camera or with the camera, template data associated with eye movements and ocular dynamics of the user as the user looks at the preprogrammed visual stimulus.

### Claim 33

A computer-implemented system, comprising:
one or more processors; and
one or more computer-readable storage media coupled to the one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations for authenticating a user based on passive affective and knowledge-based authentication (AKBA) comprising:
capturing, with a camera, data associated with eye movements and ocular dynamics of the user as the user looks at a graphical user interface (GUI) of a device, wherein a stimulus displayed on the GUI comprises at least one first image relating to at least one of positive preferences, negative preferences, or biographical experiences of the user;
determining an AKBA signature of the user based on the captured data;
authenticating the user based on a comparison of the AKBA signature with an AKBA template associated with the user, wherein the AKBA template is pregenerated based on the user's eye movements and ocular dynamics in response to a preprogrammed visual stimulus comprising at least one second image relating to at least one of the positive preferences, the negative preferences, or the biographical experiences; and
granting access to a subset of functions of an application in response to authenticating the user based on the comparison of the AKBA signature with the AKBA template.

### Claim 34 (depends on 33)

The computer-implemented system of claim 33, wherein the stimulus displayed on the GUI is configured to gauge true memories of the user.

### Claim 35 (depends on 33)

The computer-implemented system of claim 33, wherein authenticating the user comprises:
generating a similarity score based on the comparison of the AKBA signature with the AKBA template; and
authenticating the user based on the similarity score, wherein the user is authenticated when the similarity score is within a range of a predetermined threshold.

### Claim 36 (depends on 35)

The computer-implemented system of claim 35, wherein generating the similarity score comprises:
determining a plurality of first scores, wherein each first score is determined based on a comparison of a measurement of a respective feature comprised in the AKBA template and a measurement of a corresponding same feature comprised in the AKBA signature;
determining a respective weight for each of the first scores; and
combining the first scores weighted by their respective weights to determine the similarity score.

### Claim 37 (depends on 33)

The computer-implemented system of claim 33, wherein the AKBA template of the user is pregenerated during an enrollment process.

### Claim 38 (depends on 37)

The computer-implemented system of claim 37, wherein the operations comprise pregenerating the AKBA template of the user during the enrollment process, and wherein pregenerating the AKBA comprises:
querying the user about at least one of the positive preferences, negative preferences, or biographical experiences;
displaying the preprogrammed visual stimulus comprising the at least one second image; and
capturing, with a second camera or with the camera, template data associated with eye movements and ocular dynamics of the user as the user looks at the preprogrammed visual stimulus.
