# US 12,217,546 B2 · Spoof detection using head pose to eye gaze correspondence

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,217,546 B2
- Document ID: US12217546B2
- Status: Granted
- Kind: B2
- Application number: 17/704,927
- Filed: 2022-03-25
- Published: 2023-09-28
- Granted: 2025-02-04
- Earliest claimed: 2022-03-25
- Assignees: Jumio Corporation
- Applicants: Jumio Corporation
- Inventors: Spandana Vemulapalli
- Web page: https://patentgrep.com/patent/US12217546B2

## CPC

- G06V 40/166: {using acquisition arrangements}
- G06V 40/40: Spoof detection, e.g. liveness detection
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 40/193: {Preprocessing; Feature extraction}
- G06V 40/45: {Detection of the body part being alive}
- G06T 2207/30201: Face
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Methods, systems, and computer-readable storage media for determining that a subject is a live person include providing instructions for performing a head movement, capturing a set of images of a subject subsequent to providing the instructions to perform the head movement, determining, from the set of images, a first metric indicative of an amount of change in eye gaze directions of the subject during the head movement, determining, from the set of images, a second metric indicative of a change in head positions of the subject during the head movement, determining, based at least on the first metric and the second metric, a third metric indicative of a likelihood that the subject is a live person, determining that the third metric satisfies a first threshold condition, and in response to determining that the third metric satisfies the first threshold condition, identifying the subject as a live person.

## Claims

### Claim 1

A computer-implemented method comprising:
providing, by a processor of a user device having a camera, instructions on a display panel of the user device, the instructions provided for performing a head movement;
capturing a set of images of a subject using the camera of the user device subsequent to providing the instructions to perform the head movement;
determining, by the processor from the set of images, a first metric indicative of an amount of change in eye gaze directions of the subject during the head movement;
determining, by the processor from the set of images, a second metric indicative of a change in head positions of the subject during the head movement;
determining, by the processor based at least on the first metric and the second metric, a third metric indicative of a likelihood that the subject is a live person, wherein the third metric is a weighted sum of (i) the second metric and (ii) an inverse of the first metric;
determining that the third metric satisfies a first threshold condition; and
in response to determining that the third metric satisfies the first threshold condition, identifying the subject as a live person.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the instructions provide an optical target that is displayed by a device screen for the subject to look at, while the set of images is being captured.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the first metric is substantially proportional to the amount of change in eye gaze directions.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the second metric is substantially proportional to an amount of change in the head positions during the head movement.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the third metric is a weighted sum of (i) the second metric and (ii) the first metric.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the instructions to perform the head movement comprise instructions to perform one of: a yaw, a pitch or a roll of a head of the subject.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining a presence of at least one transitional state as a head position changes from an initial head position to a final head position; and
determining that the head movement between the initial head position and the final head position exceeds a second threshold condition.

### Claim 8

A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations comprising:
providing, by a processor of a user device having a camera, instructions on a display panel of the user device, the instructions provided for performing a head movement;
capturing a set of images of a subject using the camera of the user device subsequent to providing the instructions to perform the head movement;
determining, by the processor from the set of images, a first metric indicative of an amount of change in eye gaze directions of the subject during the head movement;
determining, by the processor from the set of images, a second metric indicative of a change in head positions of the subject during the head movement;
determining, by the processor based at least on the first metric and the second metric, a third metric indicative of a likelihood that the subject is a live person, wherein the third metric is a weighted sum of (i) the second metric and (ii) an inverse of the first metric;
determining that the third metric satisfies a first threshold condition; and
in response to determining that the third metric satisfies the first threshold condition, identifying the subject as a live person.

### Claim 9 (depends on 8)

The non-transitory, computer-readable medium of claim 8, wherein the instructions provide an optical target that is displayed by a device screen for the subject to look at, while the set of images is being captured.

### Claim 10 (depends on 8)

The non-transitory, computer-readable medium of claim 8, wherein the first metric is substantially proportional to the amount of change in eye gaze directions.

### Claim 11 (depends on 8)

The non-transitory, computer-readable medium of claim 8, wherein the second metric is substantially proportional to an amount of change in the head positions during the head movement.

### Claim 12 (depends on 8)

The non-transitory, computer-readable medium of claim 8, wherein the third metric is a weighted sum of (i) the second metric and (ii) the first metric.

### Claim 13

A computer-implemented system comprising:
one or more computers; and
one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform operations comprising:
providing, by a processor of a user device having a camera, instructions on a display panel of the user device, the instructions provided for performing a head movement;
capturing a set of images of a subject using the camera of the user device subsequent to providing the instructions to perform the head movement;
determining, by the processor from the set of images, a first metric indicative of an amount of change in eye gaze directions of the subject during the head movement;
determining, by the processor from the set of images, a second metric indicative of a change in head positions of the subject during the head movement;
determining, by the processor based at least on the first metric and the second metric, a third metric indicative of a likelihood that the subject is a live person, wherein the third metric is a weighted sum of (i) the second metric and (ii) an inverse of the first metric;
determining that the third metric satisfies a first threshold condition; and
in response to determining that the third metric satisfies the first threshold condition, identifying the subject as a live person.

### Claim 14 (depends on 13)

The computer-implemented system of claim 13, wherein the instructions provide an optical target that is displayed by a device screen for the subject to look at, while the set of images is being captured.

### Claim 15 (depends on 13)

The computer-implemented system of claim 13, wherein the first metric is substantially proportional to the amount of change in eye gaze directions.

### Claim 16 (depends on 13)

The computer-implemented system of claim 13, wherein the second metric is substantially proportional to an amount of change in the head positions during the head movement.

### Claim 17 (depends on 13)

The computer-implemented system of claim 13, wherein the third metric is a weighted sum of (i) the second metric and (ii) the first metric.
