# US 2021/0279447 A1 · Systems and methods for anti-spoofing protection using multi-frame feature point analysis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279447 A1
- Document ID: US20210279447A1
- Status: Published application
- Kind: A1
- Application number: 17/190,536
- Filed: 2021-03-03
- Published: 2021-09-09
- Earliest claimed: 2020-03-03
- Assignees: Cyberlink Corp.
- Applicants: CyberLink Corp.
- Inventors: Fu-Kai CHUANG; Sheng-Hung LIU
- Web page: https://patentgrep.com/patent/US20210279447A1

## CPC

- G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships}
- G06V 40/172: {Classification, e.g. identification}
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06V 40/168: {Feature extraction; Face representation}
- G06V 40/40: Spoof detection, e.g. liveness detection
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A computing device captures a live video of a user. For a first frame of the live video, the computing device identifies a first facial region of the user, determines a first plurality of regions of interest within the first facial region, and identifies feature points for each of the first plurality of regions of interest. For a second frame, the computing device identifies a second facial region of the user, determines a second plurality of regions of interest within the second facial region, and identifies feature points for each of the second plurality of regions of interest. The computing device generates transformed coordinates of first background feature points. The computing device determines a difference value between coordinates of second background feature points and the transformed coordinates of the first background feature points. The computing device determines whether the user is spoofing the computing device based on the difference value.

## Claims

### Claim 1

A method implemented in a computing device, comprising:
capturing a live video of a user;
for a first frame of the live video:
identifying a first facial region of the user;
determining a first plurality of regions of interest within the first facial region; and
identifying a plurality of feature points for each of the first plurality of regions of interest;
for a second frame of the live video:
identifying a second facial region of the user;
determining a second plurality of regions of interest within the second facial region; and
identifying a plurality of feature points for each of the second plurality of regions of interest, wherein locations of the feature points in the second plurality of regions of interest in the second frame coincide with locations of the feature points in the first plurality of regions of interest in the first frame;
generating a perspective transform matrix based on locations of the feature points in the second plurality of regions of interest in the second frame and locations of the feature points in the first plurality of regions of interest in the first frame to generate transformed coordinates of a plurality of first background feature points;
determining a difference value between coordinates of a plurality of second background feature points and the transformed coordinates of the plurality of first background feature points; and
determining whether the user is spoofing the computing device based on the difference value.

### Claim 2 (depends on 1)

The method of claim 1, wherein a determination is made that the user is spoofing the computing device when the difference value is less than a threshold value.

### Claim 3 (depends on 1)

The method of claim 1, wherein the feature points in the first plurality of regions of interest and the feature points in the second plurality of regions of interest within the first facial region are detected using a scale-invariant feature transform (SIFT) algorithm or a speeded up robust features (SURF) algorithm.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
for the first frame of the live video:
determining a plurality of first background feature points outside the first facial region;
for the second frame of the live video:
determining a plurality of second background feature points outside the second facial region, wherein locations of the first background feature points coincide with locations of the second background feature points; and
generating the transformed coordinates of the plurality of first background points based on the perspective transform matrix and the plurality of first background feature points.

### Claim 5

A system, comprising:
a memory storing instructions;
a processor coupled to the memory and configured by the instructions to at least:
capture a live video of a user;
for a first frame of the live video:
identify a first facial region of the user;
determine a first plurality of regions of interest within the first facial region; and
identify a plurality of feature points for each of the first plurality of regions of interest;
for a second frame of the live video:
identify a second facial region of the user;
determine a second plurality of regions of interest within the second facial region; and
identify a plurality of feature points for each of the second plurality of regions of interest, wherein locations of the feature points in the second plurality of regions of interest in the second frame coincide with locations of the feature points in the first plurality of regions of interest in the first frame;
generate a perspective transform matrix based on locations of the feature points in the second plurality of regions of interest in the second frame and locations of the feature points in the first plurality of regions of interest in the first frame to generate transformed coordinates of a plurality of first background feature points;
determine a difference value between coordinates of a plurality of second background feature points and the transformed coordinates of the plurality of first background feature points; and
determine whether the user is spoofing the system based on the difference value.

### Claim 6 (depends on 5)

The system of claim 5, wherein the processor determines that that the user is spoofing the system when the difference value is less than a threshold value.

### Claim 7 (depends on 5)

The system of claim 5, wherein the feature points in the first plurality of regions of interest and the feature points in the second plurality of regions of interest within the first facial region are detected by the processor using a scale-invariant feature transform (SIFT) algorithm or a speeded up robust features (SURF) algorithm.

### Claim 8 (depends on 5)

The system of claim 5, wherein the processor is further configured to:
for the first frame of the live video:
determine a plurality of first background feature points outside the first facial region;
for the second frame of the live video:
determine a plurality of second background feature points outside the second facial region, wherein locations of the first background feature points coincide with locations of the second background feature points; and
generate the transformed coordinates of the plurality of first background points based on the perspective transform matrix and the plurality of first background feature points.

### Claim 9

A non-transitory computer-readable storage medium storing instructions to be implemented by a computing device having a processor, wherein the instructions, when executed by the processor, cause the computing device to at least:
capture a live video of a user;
for a first frame of the live video:
identify a first facial region of the user;
determine a first plurality of regions of interest within the first facial region; and
identify a plurality of feature points for each of the first plurality of regions of interest;
for a second frame of the live video:
identify a second facial region of the user;
determine a second plurality of regions of interest within the second facial region; and
identify a plurality of feature points for each of the second plurality of regions of interest, wherein locations of the feature points in the second plurality of regions of interest in the second frame coincide with locations of the feature points in the first plurality of regions of interest in the first frame;
generate a perspective transform matrix based on locations of the feature points in the second plurality of regions of interest in the second frame and locations of the feature points in the first plurality of regions of interest in the first frame to generate transformed coordinates of a plurality of first background feature points;
determine a difference value between coordinates of a plurality of second background feature points and the transformed coordinates of the plurality of first background feature points; and
determine whether the user is spoofing the computing device based on the difference value.

### Claim 10 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the processor determines that that the user is spoofing the computing device when the difference value is less than a threshold value.

### Claim 11 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the feature points in the first plurality of regions of interest and the features points in the second plurality of regions of interest within the first facial region are detected by the processor using a scale-invariant feature transform (SIFT) algorithm ora speeded up robust features (SURF) algorithm.

### Claim 12 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the processor is further configured to:
for the first frame of the live video:
determine a plurality of first background feature points outside the first facial region;
for the second frame of the live video:
determine a plurality of second background feature points outside the second facial region, wherein locations of the first background feature points coincide with locations of the second background feature points; and
generate the transformed coordinates of the plurality of first background points based on the perspective transform matrix and the plurality of first background feature points.
