# US 2021/0279439 A1 · Method and system for imaging fingerprint under screen, and screen

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279439 A1
- Document ID: US20210279439A1
- Status: Published application
- Kind: A1
- Application number: 17/156,695
- Filed: 2021-01-25
- Published: 2021-09-09
- Earliest claimed: 2020-03-03
- Assignees: Boe Technology Group Co., Ltd.
- Applicants: BOE Technology Group Co., Ltd.
- Inventors: Yapeng Li; Haisheng Wang; Xiaoliang Ding; Xueyou Cao; Yangbing Li; Yuanyuan Ma; Wenjuan Wang; Jiabin Wang
- Web page: https://patentgrep.com/patent/US20210279439A1

## CPC

- G06V 40/1318: {using electro-optical elements or layers, e.g. electroluminescent sensing}
- G06F 3/0421: {by interrupting or reflecting a light beam, e.g. optical touch-screen}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method for imaging a fingerprint under a screen, including: acquiring a finger pressing area formed by a finger pressing on the screen; determining a first light source and a second light source of the screen based on the finger pressing area, wherein arrangement directions of the first light source and the second light source are not perpendicular to a long axis of the finger pressing area; acquiring a first fingerprint image after the first light source is turned on, and a second fingerprint image after the second light source is turned on; and splicing the first fingerprint image and the second fingerprint image to acquire a target fingerprint image.

## Claims

### Claim 1

A method for imaging a fingerprint under a screen, comprising:
acquiring a finger pressing area formed by a finger pressing on the screen;
determining a first light source and a second light source of the screen based on the finger pressing area, wherein arrangement directions of the first light source and the second light source are not perpendicular to a long axis of the finger pressing area;
acquiring a first fingerprint image after the first light source is turned on, and a second fingerprint image after the second light source is turned on; and
splicing the first fingerprint image and the second fingerprint image to acquire a target fingerprint image.

### Claim 2 (depends on 1)

The method for imaging the fingerprint under the screen according to claim 1, wherein said determining the first light source and the second light source of the screen based on the finger pressing area comprises:
acquiring a center point of the finger pressing area and the long axis of the finger pressing area;
acquiring a reference point corresponding to the center point of the finger pressing area in a fingerprint acquisition coordinate system, and a reference axis corresponding to the long axis of the finger pressing area in the fingerprint acquisition coordinate system, wherein the fingerprint acquisition coordinate system is a coordinate system where fingerprint images are located; and
determining the first light source and the second light source located on both sides of the reference point on the reference axis.

### Claim 3 (depends on 2)

The method for imaging the fingerprint under the screen according to claim 2, wherein said acquiring the finger pressing area formed by the finger pressing on the screen comprises:
acquiring a signal matrix composed of touch points pressed by the finger on the screen, wherein the signal matrix comprises information on the finger pressing area.

### Claim 4 (depends on 3)

The method for imaging the fingerprint under the screen according to claim 3, wherein said acquiring the center point of the finger pressing area and the long axis of the finger pressing area comprises:
determining a center of gravity of the signal matrix as the center point of the finger pressing area; and
determining the long axis of the finger pressing area based on a central moment of the signal matrix.

### Claim 5 (depends on 4)

The method for imaging the fingerprint under the screen according to claim 4, wherein said determining the long axis of the finger pressing area based on the central moment of the signal matrix comprises:
determining the long axis of the finger pressing area based on a second-order central moment of the signal matrix.

### Claim 6 (depends on 3)

The method for imaging the fingerprint under the screen according to claim 3, wherein said acquiring the reference point corresponding to the center point of the finger pressing area in the fingerprint acquisition coordinate system, and the reference axis corresponding to the long axis of the finger pressing area in the fingerprint acquisition coordinate system comprises:
determining the reference point and the reference axis based on a mapping relationship between a touch coordinate system and the fingerprint acquisition coordinate system, as well as the center point of the finger pressing area and the long axis of the finger pressing area, wherein the touch coordinate system is a coordinate system where the finger pressing area is located.

### Claim 7 (depends on 6)

The method for imaging the fingerprint under the screen according to claim 6, wherein the mapping relationship comprises:
{
S
x
=
A
1
⁢
T
x
+
B
1
⁢
T
y
+
C
1
S
y
=
A
2
⁢
T
x
+
B
2
⁢
T
y
+
C
2
,
wherein Sx is a coordinate of an x-axis in the touch coordinate system; Sy is a coordinate of a y-axis in the touch coordinate system; Tx is a coordinate of an x-axis in the fingerprint acquisition coordinate system; Ty is a coordinate of a y-axis in the fingerprint acquisition coordinate system; and A1, B1, C1, A2, B2, and C2 are mapping coefficients acquired by calibration.

### Claim 8 (depends on 7)

The method for imaging the fingerprint under the screen according to claim 7, wherein the mapping relationship comprises:
θs=θT−arcTan(B1/A1);
wherein θT is an angle between the long axis of the finger pressing area and the x-axis in the touch coordinate system; and θS is an angle between the reference axis and the x-axis in the fingerprint acquisition coordinate system.

### Claim 9 (depends on 1)

The method for imaging the fingerprint under the screen according to claim 1, wherein a distance between the first light source and the second light source is greater than or equal to 2R, and the R is a radius of a circular invalid imaging area of the light sources of the screen on a contact surface between the finger and the screen.

### Claim 10 (depends on 1)

The method for imaging the fingerprint under the screen according to claim 1, wherein said determining the first light source and the second light source of the screen based on the finger pressing area comprises:
acquiring the center point of the finger pressing area and the long axis of the finger pressing area;
determining the reference point and the reference axis based on the mapping relationship between the touch coordinate system and the fingerprint acquisition coordinate system, as well as the center point of the finger pressing area and the long axis of the finger pressing area, wherein the fingerprint acquisition coordinate system is a coordinate system where the finger images are located; and
determining the first light source and the second light source located on both sides of the reference point on the reference axis, wherein the distance between the first light source and the second light source is greater than or equal to 2R, and the R is the radius of the circular invalid imaging area of the light sources of the screen on the contact surface of the finger and the screen.

### Claim 11

A system for imaging a fingerprint under a screen, comprising:
a touch circuit configured to acquire a finger pressing area formed by a finger pressing on the screen;
a processor configured to determine a first light source and a second light source of the screen based on the finger pressing area, wherein arrangement directions of the first light source and the second light source are not perpendicular to a long axis of the finger pressing area; and
an image acquiring assembly configured to acquire a first fingerprint image after the first light source is turned on, and a second fingerprint image after the second light source is turned on; and
wherein the processor splices the first fingerprint image and the second fingerprint image to acquire a target fingerprint image.

### Claim 12 (depends on 11)

The system for imaging the fingerprint under the screen according to claim 11, wherein the processor is configured to:
acquire a center point of the finger pressing area and the long axis of the finger pressing area;
acquire a reference point corresponding to the center point of the finger pressing area in a fingerprint acquisition coordinate system, and a reference axis corresponding to the long axis of the finger pressing area in the fingerprint acquisition coordinate system, wherein the fingerprint acquisition coordinate system is a coordinate system where fingerprint images are located; and
determine the first light source and the second light source located on both sides of the reference point on the reference axis.

### Claim 13 (depends on 12)

The system for imaging the fingerprint under the screen according to claim 12, wherein the touch circuit is configured to:
acquire a signal matrix composed of touch points pressed by the finger on the screen, wherein the signal matrix comprises information on the finger pressing area.

### Claim 14 (depends on 12)

The system for imaging the fingerprint under the screen according to claim 12, wherein the processor is configured to:
determine a center of gravity of the signal matrix as the center point of the finger pressing area; and
determine the long axis of the finger pressing area based on a central moment of the signal matrix.

### Claim 15 (depends on 13)

The system for imaging the fingerprint under the screen according to claim 13, wherein the processor is configured to:
determine the reference point and the reference axis based on a mapping relationship between a touch coordinate system and the fingerprint acquisition coordinate system, as well as the center point of the finger pressing area and the long axis of the finger pressing area, wherein the touch coordinate system is a coordinate system where the finger pressing area is located.

### Claim 16 (depends on 15)

The system for imaging the fingerprint under the screen according to claim 15, wherein the mapping relationship comprises:
{
S
x
=
A
1
⁢
T
x
+
B
1
⁢
T
y
+
C
1
S
y
=
A
2
⁢
T
x
+
B
2
⁢
T
y
+
C
2
;
⁢
θ
s
=
θ
T
-
arc
⁢
⁢
Tan
⁡
(
B
1
/
A
1
)
;
wherein Sx is a coordinate of an x-axis in the touch coordinate system; Sy is a coordinate of a y-axis in the touch coordinate system; Tx is a coordinate of an x-axis in the fingerprint acquisition coordinate system; Ty is a coordinate of a y-axis in the fingerprint acquisition coordinate system; A1, B1, C1, A2, B2, and C2 are mapping coefficients acquired by calibration; θT is an angle between the long axis of the finger pressing area and the x-axis in the touch coordinate system; and θS is an angle between the reference axis and the x-axis in the fingerprint acquisition coordinate system.

### Claim 17 (depends on 12)

The system for imaging the fingerprint under the screen according to claim 12, wherein a distance between the first light source and the second light source is greater than or equal to 2R, and the R is a radius of a circular invalid imaging area of the light sources of the screen on a contact surface between the finger and the screen.

### Claim 18 (depends on 11)

The system for imaging the fingerprint under the screen according to claim 11, wherein the image acquiring assembly comprises an image acquisition circuit, the image acquisition circuit comprises sensor units which are arranged in rows and columns, each of the sensor units comprises a PIN photodiode and a TFT, a cathode of the PIN photodiode in each of the sensors unit is electrically connected to a drain of the TFT; and
an anode of the PIN photodiode is electrically connected to a voltage input terminal, a gate of the TFT in each row of the sensor units is electrically connected to a gate control signal line, and a source of the TFT in each column of the sensor units is electrically connected to an integrator.

### Claim 19 (depends on 18)

The system for imaging the fingerprint under the screen according to claim 18, wherein the anode of each PIN photodiode is connected to a negative voltage when the image acquisition circuit works.

### Claim 20

A screen, comprising a system for imaging a fingerprint under the screen, wherein the system for imaging the fingerprint under the screen comprises:
a touch circuit configured to acquire a finger pressing area formed by a finger pressing on the screen;
a processor configured to determine a first light source and a second light source of the screen based on the finger pressing area, wherein arrangement directions of the first light source and the second light source are not perpendicular to a long axis of the finger pressing area; and
an image acquisition circuit configured to acquire a first fingerprint image after the first light source is turned on, and a second fingerprint image after the second light source is turned on; and
wherein the processor splices the first fingerprint image and the second fingerprint image to acquire a target fingerprint image.
