# US 2024/0004980 A1 · Method, device, and storage medium for user authentication

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004980 A1
- Document ID: US20240004980A1
- Status: Published application
- Kind: A1
- Application number: 18/467,169
- Filed: 2023-09-14
- Published: 2024-01-04
- Earliest claimed: 2021-03-15
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Jinwook CHUN; Valeriy PRUSHINSKIY; Sungoh KIM; Hyungsok YEO; Kihuk LEE
- Web page: https://patentgrep.com/patent/US20240004980A1

## CPC

- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06F 21/31: User authentication
- G06F 21/45: Structures or tools for the administration of authentication
- G06F 21/79: in semiconductor storage media, e.g. directly-addressable memories
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- G06V 40/172: {Classification, e.g. identification}
- G06V 40/18: Eye characteristics, e.g. of the iris
- G06V 40/193: {Preprocessing; Feature extraction}
- G06V 40/45: {Detection of the body part being alive}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

According to various embodiments, an electronic device may comprise: a memory; a display; a plurality of cameras disposed below the display; and at least one processor operatively connected to the memory, the display, and the plurality of cameras, wherein the at least one processor is configured to, while controlling a plurality of pixel areas of the display, which correspond to the plurality of cameras, acquire a plurality of images of a user through the plurality of cameras, obtain a final image based on at least one image among the plurality of images, and authenticate the user based on the final image.

## Claims

### Claim 1

An electronic device comprising:
memory;
a display;
a plurality of cameras disposed under the display; and
at least one processor operatively connected to the memory, the display, and the plurality of cameras,
wherein one or more of the at least one processor is configured to:
obtain a plurality of images of a user through the plurality of cameras while controlling a plurality of pixel areas of the display corresponding to the plurality of cameras;
obtain a final image, based on at least one of the plurality of images; and
perform authentication of the user, based on the final image.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein one or more of the at least one processor is configured to:
alternately activate or deactivate at least one first pixel included in a first pixel area among the plurality of pixel areas and at least one second pixel included in a second pixel area among the plurality of pixel areas;
obtain at least one first image of the user through a first camera disposed under the first pixel area, among the plurality of cameras, while the at least one first pixel is deactivated; and
obtain at least one second image of the user through a second camera disposed under the second pixel area, among the plurality of cameras, while the at least one second pixel is deactivated.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein one or more of the at least one processor is configured to obtain, as the final image, an image having a least interference from among the at least one first image and the at least one second image.

### Claim 4 (depends on 2)

The electronic device of claim 2, wherein one or more of the at least one processor is configured to obtain, as the final image, an image produced by integrating a portion of the at least one first image with the least interference and a portion of the at least one second image with the least interference.

### Claim 5 (depends on 2)

The electronic device of claim 2, wherein one or more of the at least one processor is configured to:
obtain at least one third image of the user through the first camera while the at least one first pixel is activated;
obtain at least one fourth image of the user through the second camera while the at least one second pixel is activated; and
use interference information included in each of the at least one third image and the at least one fourth image as additional information for performing the authentication.

### Claim 6 (depends on 2)

The electronic device of claim 2, wherein one or more of the at least one processor is configured to:
identify whether a surrounding brightness value of the first pixel area is less than a threshold value based on the at least one first pixel being deactivated;
control the at least one second pixel included in the second pixel area to emit a configured amount of light based on the surrounding brightness value of the first pixel area being less than the threshold value; and
obtain the at least one first image of the user through the first camera disposed under the first pixel area while the at least one second pixel emits the light.

### Claim 7 (depends on 2)

The electronic device of claim 2, wherein one or more of the at least one processor is configured to:
change the amount of light emitted from the at least one second pixel within a configured range based on the at least one first pixel being deactivated;
collect images through the first camera while the amount of light is changed within the configured range;
based on the collected images, determine whether there is a change in a pupil of the user based on the changed amount of light; and
determine whether an authentication object is a living body, based on the determination result.

### Claim 8

A method of performing user authentication in an electronic device, the method comprising:
obtaining a plurality of images of a user through a plurality of cameras disposed under a display while controlling a plurality of pixel areas of the display corresponding to the plurality of cameras;
obtaining a final image, based on at least one of the plurality of images; and
performing authentication of the user, based on the final image.

### Claim 9 (depends on 8)

The method of claim 8, wherein the obtaining of the plurality of images comprises:
alternately activating or deactivating at least one first pixel included in a first pixel area among the plurality of pixel areas and at least one second pixel included in a second pixel area among the plurality of pixel areas;
obtaining at least one first image of the user through a first camera disposed under the first pixel area, among the plurality of cameras, while the at least one first pixel is deactivated; and
obtaining at least one second image of the user through a second camera disposed under the second pixel area, among the plurality of cameras, while the at least one second pixel is deactivated.

### Claim 10 (depends on 9)

The method of claim 9, wherein the obtaining of the final image comprises obtaining, as the final image, an image having a least interference from among the at least one first image and the at least one second image.

### Claim 11 (depends on 9)

The method of claim 9, wherein the obtaining of the final image comprises obtaining, as the final image, an image produced by integrating a portion of the at least one first image with the least interference and a portion of the at least one second image with the least interference.

### Claim 12 (depends on 9)

The method of claim 9, further comprising:
obtaining at least one third image of the user through the first camera while the at least one first pixel is activated;
obtaining at least one fourth image of the user through the second camera while the at least one second pixel is activated; and
using interference information included in each of the at least one third image and the at least one fourth image as additional information for performing the authentication.

### Claim 13 (depends on 9)

The method of claim 9, wherein the obtaining of the at least one first image of the user comprises:
identifying whether a surrounding brightness value of the first pixel area is less than a threshold value based on the at least one first pixel being deactivated;
controlling the at least one second pixel included in the second pixel area to emit a configured amount of light based on the surrounding brightness value of the first pixel area being less than the threshold value; and
obtaining the at least one first image of the user through the first camera disposed under the first pixel area while the at least one second pixel is emitting the light.

### Claim 14 (depends on 9)

The method of claim 9, further comprising:
changing the amount of light emitted from the at least one second pixel within a configured range based on the at least one first pixel being deactivated;
collecting images through the first camera while the amount of light is changed within the configured range;
based on the collected images, determining whether there is a change in a pupil of the user depending on the changed amount of light; and
determining whether an authentication object is a living body, based on the determination result.

### Claim 15

A non-transitory computer-readable storage medium storing instructions, which, when executed by one or more of at least one processor of an electronic device, cause the electronic device to perform at least one operation,
wherein the at least one operation comprises:
obtaining a plurality of images of a user through a plurality of cameras disposed under a display while controlling a plurality of pixel areas of the display corresponding to the plurality of cameras;
obtaining a final image, based on at least one of the plurality of images; and
performing authentication of the user, based on the final image.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein obtaining the plurality of images comprises:
alternately activating or deactivating at least one first pixel included in a first pixel area among the plurality of pixel areas and at least one second pixel included in a second pixel area among the plurality of pixel areas;
obtaining at least one first image of the user through a first camera disposed under the first pixel area, among the plurality of cameras, while the at least one first pixel is deactivated; and
obtaining at least one second image of the user through a second camera disposed under the second pixel area, among the plurality of cameras, while the at least one second pixel is deactivated.

### Claim 17 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein obtaining the final image comprises:
obtaining, as the final image, an image having a least interference from among the at least one first image and the at least one second image.

### Claim 18 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the at least one operation comprises:
obtaining at least one third image of the user through the first camera while the at least one first pixel is activated;
obtaining at least one fourth image of the user through the second camera while the at least one second pixel is activated; and
using interference information included in each of the at least one third image and the at least one fourth image as additional information for performing the authentication.

### Claim 19 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein obtaining at least one first image of the user comprises:
identifying whether a surrounding brightness value of the first pixel area is less than a threshold value based on the at least one first pixel being deactivated;
controlling the at least one second pixel included in the second pixel area to emit a configured amount of light based on the surrounding brightness value of the first pixel area being less than the threshold value; and
obtaining the at least one first image of the user through the first camera disposed under the first pixel area while the at least one second pixel emits the light.

### Claim 20 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the at least one operation comprises:
changing the amount of light emitted from the at least one second pixel within a configured range based on the at least one first pixel being deactivated;
collecting images through the first camera while the amount of light is changed within the configured range;
based on the collected images, determining whether there is a change in a pupil of the user based on the changed amount of light; and
determining whether an authentication object is a living body, based on the determination result.
