# US 2020/0394292 A1 · Method of device unlocking and device utilizing the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0394292 A1
- Document ID: US20200394292A1
- Status: Published application
- Kind: A1
- Application number: 17/008,585
- Filed: 2020-08-31
- Published: 2020-12-17
- Earliest claimed: 2019-02-14
- Assignees: Nanning Fugui Precision Industrial Co., Ltd.
- Applicants: Nanning Fugui Precision Industrial Co., Ltd.
- Inventors: PI-LUN CHENG; HSUAN-KUEI HUANG
- Web page: https://patentgrep.com/patent/US20200394292A1

## CPC

- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 21/36: by graphic or iconic representation
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 40/16: Human faces, e.g. facial parts, sketches or expressions
- G06V 40/193: {Preprocessing; Feature extraction}
- G06V 40/197: {Matching; Classification}
- H04W 12/06: Authentication
- H04W 12/08: Access security
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A device unlocking method. The method shows challenging icons in challenging rounds and traces user pupils. The method requires a right user to have his pupil movement conform to a challenging icon through the challenging rounds. A device unlocks when a combined moving vector representing the pupil movement passes the challenging rounds and matches an unlocking condition.

## Claims

### Claim 1

A device unlocking method based on eye recognition executable by an electronic device, comprising:
identifying one or more users in a captured sequence of images;
determining a total number of users identified in the captured sequence of images as M;
selecting N icons for unlocking challenges;
determining a challenging number R of challenging rounds based on the total number M of users;
displaying a challenging item with only one predefined icon showing the unlocking patterns;
determining whether any user of a user set U having pupil movement conform to the unlocking patterns of the predefined icon;
when at least one user having the pupil movement conforms to the predefined icon, determining whether at least one right user is identified and the challenging number R is greater than a preset number; and
if the right user is identified and the challenging number R does not exceed the preset number, counting down the challenging number R;
determining whether the challenging number R is equal to zero; and
when the challenging number R is equal to zero, determining a combined moving vector Xtrace_n matches a predefined unlock condition and performing device unlocking accordingly.

### Claim 2 (depends on 1)

The device unlocking method of claim 1, further comprising:
if the right user is identified and the challenging number R is greater than the preset number, setting the challenging number R equals to the preset number, speeding up the unlock challenging, and beginning another challenging round.

### Claim 3 (depends on 1)

The device unlocking method of claim 1, further comprising:
when the user of the combined moving vector Xtrace_n does not conform to a predefined icon, determining whether the challenging round is the first round; and
if the challenging round is not the first round, determining the combined moving vector Xtrace_n is a wrong input, stopping tracking the user, and removing the user from a traced user set T.

### Claim 4 (depends on 3)

The device unlocking method of claim 3, further comprising:
if the challenging round is the first round, determining whether the combined moving vector Xtrace_n matches a predefined application launch command associated with a first application; and
when the combined moving vector Xtrace_n matches the predefined application launch command, launching the first application in the background followed by the device unlocking.

### Claim 5 (depends on 4)

The device unlocking method of claim 4, further comprising:
when the combined moving vector Xtrace_n does not match the predefined application launch command, stopping tracking the user and removing the user from the traced user set T;
determining whether any user remains in the traced user set T;
when no user is being tracked and the traced user set T is empty, denying access to the device; and
when at least one user is being tracked and the traced user set T is not empty, determining whether at least one right user is identified and the challenging number R is greater than the preset number.

### Claim 6 (depends on 1)

The device unlocking method of claim 1, further comprising:
determining the challenging number R use the following formula:
R=2+└logNM┘, wherein M indicates the total number of the users and N indicates the number of icons.

### Claim 7 (depends on 1)

The device unlocking method of claim 1, further comprising:
obtaining the combined moving vector Xtrace_n according to the following formula:
X
trace_n
=
2
×
A
n
3
+
B
n
3
,
wherein An is a first moving vector, of a first character point, which is weighted with the first weight of ⅔, Bn is a second moving vector, of a second character point, which is weighted with the second weight of ⅓.

### Claim 8 (depends on 7)

The device unlocking method of claim 7, further comprising:
obtaining four intersection points where a circumference of a pupil image the right user intersects with two axes, wherein each of the two axes passes through a center of the pupil image;
obtaining a compensation diversity coordinate of the four intersection points as the first character point;
obtaining a Hough circle from the pupil image; and
obtaining a center point of the Hough circle and defining the center point of the Hough circle as the second character point.

### Claim 9 (depends on 8)

The device unlocking method of claim 8, further comprising:
obtaining the compensation diversity coordinate according to the following formula:
ξ
n
=
∑
i
=
1
i
=
4

C

[
i
]

(
x
i
,
y
i
)
4
,
wherein i is an integer variable, n is an integer variable in a time domain and (xi, yi) is the coordinates of the intersections.

### Claim 10

A device comprising:
a camera capturing pupil images; and
a processor executing a device unlocking method, comprising the steps of:
identifying one or more users in a captured sequence of images;
determining a total number of users identified in the captured sequence of images as M;
selecting N icons for unlocking challenges;
determining a challenging number R of challenging rounds based on the total number M of users;
displaying a challenging item with only one predefined icon showing the unlocking patterns;
determining whether any user of a user set U having pupil movement conform to the unlocking patterns of the predefined icon;
when at least one user having the pupil movement conforms to the predefined icon, determining whether at least one right user is identified and the challenging number R is greater than a preset number; and
if the right user is identified and the challenging number R does not exceed the preset number, counting down the challenging number R;
determining whether the challenging number R is equal to zero; and
when the challenging number R is equal to zero, determining a combined moving vector Xtrace_n matches a predefined unlock condition and performing device unlocking accordingly.

### Claim 11 (depends on 10)

The device of claim 10, wherein the processor further executes the steps of:
if the right user is identified and the challenging number R is greater than the preset number, setting the challenging number R equals to the preset number, speeding up the unlock challenging, and beginning another challenging round.

### Claim 12 (depends on 10)

The device of claim 10, wherein the processor further executes the steps of:
when the user of the combined moving vector Xtrace_n does not conform to a predefined icon, determining whether the challenging round is the first round; and
if the challenging round is not the first round, determining the combined moving vector Xtrace_n is a wrong input, stopping tracking the user, and removing the user from a traced user set T.

### Claim 13 (depends on 12)

The device of claim 12, wherein the processor further executes the steps of:
if the challenging round is the first round, determining whether the combined moving vector Xtrace_n matches a predefined application launch command associated with a first application; and
when the combined moving vector Xtrace_n matches the predefined application launch command, launching the first application in the background followed by the device unlocking.

### Claim 14 (depends on 13)

The device of claim 13, wherein the processor further executes the steps of:
when the combined moving vector Xtrace_n does not match the predefined application launch command, stopping tracking the user and removing the user from the traced user set T;
determining whether any user remains in the traced user set T;
when no user is being tracked and the traced user set T is empty, denying access to the device; and
when at least one user is being tracked and the traced user set T is not empty, determining whether at least one right user is identified and the challenging number R is greater than the preset number.

### Claim 15 (depends on 10)

The device of claim 10, wherein the processor further executes the steps of:
determining the challenging number R use the following formula:
R=2+└logNM┘, wherein M indicates the total number of the users and N indicates the number of icons.

### Claim 16 (depends on 10)

The device of claim 10, wherein the processor further executes the steps of:
obtaining the combined moving vector Xtrace_n according to the following formula:
X
trace_n
=
2
×
A
n
3
+
B
n
3
,
wherein An is a first moving vector, of a first character point, which is weighted with the first weight of ⅔, Bn is a second moving vector, of a second character point, which is weighted with the second weight of ⅓.

### Claim 17 (depends on 16)

The device of claim 16, wherein the processor further executes the steps of:
obtaining four intersection points where a circumference of a pupil image the right user intersects with two axes, wherein each of the two axes passes through a center of the pupil image;
obtaining a compensation diversity coordinate of the four intersection points as the first character point;
obtaining a Hough circle from the pupil image; and
obtaining a center point of the Hough circle and defining the center point of the Hough circle as the second character point.

### Claim 18 (depends on 17)

The device of claim 17, wherein the processor further executes the steps of:
obtaining the compensation diversity coordinate according to the following formula:
ξ
n
=
∑
i
=
1
i
=
4

C

[
i
]

(
x
i
,
y
i
)
4
,
wherein i is an integer variable, n is an integer variable in a time domain and (xi, yi) is the coordinates of the intersections.
