# US 2021/0240810 A1 · Method and apparatus for verifying user using multiple biometric verifiers

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0240810 A1
- Document ID: US20210240810A1
- Status: Published application
- Kind: A1
- Application number: 17/240,059
- Filed: 2021-04-26
- Published: 2021-08-05
- Earliest claimed: 2016-07-11
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Sungjoo SUH; Seungju HAN; Jae-Joon HAN; Chang Kyu CHOI
- Web page: https://patentgrep.com/patent/US20210240810A1

## CPC

- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- H04L 63/0861: {using biometrical features, e.g. fingerprint, retina-scan (cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231)}
- H04L 63/105: {Multiple levels of security}
- H04L 2463/082: applying multi-factor authentication
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A user verification apparatus may perform user verification using multiple biometric verifiers. The user verification apparatus may set a termination stage of one or more biometric verifiers. Multiple biometric verifiers may be used to generate outputs, for which separate termination stages are set to establish a particular combination of set termination stages associated with the multiple biometric verifiers, and the user verification apparatus may fuse outputs of the biometric verifiers based on the particular combination of set termination stages. The user verification apparatus may verify a user based on a result of the fusing, and an unlocking command signal may be generated based on the verifying. The unlocking command signal may be generated to selectively grant access, to the verified user, to one or more elements of a device. The device may be a vehicle.

## Claims

### Claim 1

A user verification method, comprising:
obtaining a plurality of biometric verifiers, at least one of the biometric verifiers being configured to perform a verification process that terminate at any one of a plurality of successive verification stages;
setting a termination stage of each biometric verifier of the plurality of biometric verifiers, such that each biometric verifier of the plurality of biometric verifiers is associated with a separate termination stage of a particular combination of termination stages, respectively, wherein the termination stage of each biometric verifier is one of the plurality of successive verification stages;
executing the plurality of biometric verifiers, based on the particular combination of termination stages associated with the plurality of biometric verifiers, to generate a plurality of outputs;
fusing the plurality of outputs based on the particular combination of termination stages associated with the plurality of biometric verifiers to generate a result; and
verifying a user based on the result.

### Claim 2 (depends on 1)

The method of claim 1, wherein each verification stage of the plurality of successive verification stages corresponds to at least one of a particular verification performance, a particular verification accuracy, and a particular verification speed.

### Claim 3 (depends on 1)

The method of claim 1, wherein each biometric verifier is configured to be executed to output an individual verification result through a set of stages of the biometric verifier, the set of stages including at least one stage.

### Claim 4 (depends on 3)

The method of claim 3, wherein
the set termination stage of the biometric verifier is a particular stage of the plurality of successive verification stages, and
each biometric verifier is configured to be executed to output an individual verification result corresponding to the set termination stage of the biometric verifier.

### Claim 5 (depends on 1)

The method of claim 1, wherein the setting includes
setting the termination stage based on a particular criterion.

### Claim 6 (depends on 5)

The method of claim 5, wherein the particular criterion includes at least one of:
an application type associated with a received verification request,
a security level associated with the received verification request,
a sensing environment associated with a user verification apparatus,
a determination of whether the at least one biometric verifier is to be executed to perform main verification or auxiliary verification, and
a selection by the user at a user interface.

### Claim 7 (depends on 4)

The method of claim 4, wherein the setting includes
setting, to be the set termination stage, a particular stage of the plurality of successive verification stages at which a verification rate (VR) and a false acceptance rate (FAR) associated with an individual verification result of the particular stage at least meet a threshold VR and a threshold FAR, respectively, based on a particular criterion.

### Claim 8 (depends on 1)

The method of claim 1, wherein the plurality of biometric verifiers are configured to be executed to perform biometric verification of different modalities.

### Claim 9 (depends on 1)

The method of claim 1, wherein each biometric verifier of the plurality of biometric verifiers is configured to be executed to perform biometric verification based on received biometric information, the received biometric information including one of a face, a fingerprint, an iris, a vein, palm lines, a shape of an ear, and an electrocardiogram (ECG).

### Claim 10 (depends on 1)

The method of claim 1, wherein the fusing includes
fusing the plurality of outputs based on executing a fusion model corresponding to the particular combination of termination stages associated with the plurality of biometric verifiers among a plurality of fusion models associated with separate, respective combinations of termination stages associated with the plurality of biometric verifiers.

### Claim 11 (depends on 1)

The method of claim 1, wherein the verifying includes
verifying the user based on comparing the result of the fusing and a threshold value corresponding to the particular combination of termination stages of the plurality of biometric verifiers.

### Claim 12 (depends on 1)

The method of claim 1, wherein
at least one biometric verifier of the plurality of biometric verifiers includes a fingerprint verifier,
the fingerprint verifier is configured to be executed to output an individual verification result based on executing each stage of a plurality of stages of the fingerprint verifier,
executing a first stage of the plurality of stages includes outputting an overlapping area and a matching score between a registered fingerprint image and an input fingerprint image, and
executing a second stage of the plurality of stages includes outputting matching scores between the registered fingerprint image and blocks generated based on partitioning the input fingerprint image.

### Claim 13 (depends on 1)

The method of claim 1, wherein
at least one biometric verifier of the plurality of biometric verifiers includes a face verifier, and
the face verifier is configured to be executed to output an individual verification result of each layer based on comparing features to be output by multiple layers in a neural network, based on an input image and features of a stored registered image corresponding to the layers.

### Claim 14 (depends on 1)

The method of claim 1, wherein the setting includes
selecting one biometric verifier of the plurality of biometric verifiers as a main verifier,
selecting another biometric verifier of the plurality of biometric verifiers as a sub-verifier, and
selecting, from a plurality of separate combinations of a termination stage of the main verifier and a termination stage of the sub-verifier, a particular combination of the termination stage of the main verifier and the termination stage of the sub-verifier that increases a level of the termination stage of the main verifier,
wherein the fusing includes
fusing the plurality of outputs using a fusion model configured to output a final verification result to verify the user based on an input vector of a dimension corresponding to an output of a set termination stage of the particular combination of termination stages.

### Claim 15 (depends on 1)

A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to perform the method of claim 1.

### Claim 16

A user verification apparatus, comprising:
a memory storing a program of instructions; and
a processor configured to execute the program of instructions to
obtain a plurality of biometric verifiers, at least one of the biometric verifiers being configured to perform a verification process that terminate at any one of a plurality of successive verification stages,
set a termination stage of each biometric verifier of the plurality of biometric verifiers, such that each biometric verifier of the plurality of biometric verifiers is associated with a separate termination stage of a particular combination of termination stages, respectively, wherein the termination stage of each biometric verifier is one of the plurality of successive verification stages,
execute the plurality of biometric verifiers, based on the particular combination of termination stages associated with the plurality of biometric verifiers, to generate a plurality of outputs,
fuse the plurality of outputs based on the particular combination of termination stages associated with the plurality of biometric verifiers to generate a result, and
verify a user based on the result.

### Claim 17 (depends on 16)

The user verification apparatus of claim 16, wherein each verification stage of the plurality of successive verification stages corresponds to at least one of a particular verification performance, a particular verification accuracy, and a particular verification speed.

### Claim 18 (depends on 16)

The user verification apparatus of claim 16, wherein each biometric verifier is configured to be executed to output an individual verification result through a set of stages of the biometric verifier, the set of stages including at least one stage.

### Claim 19

A smart phone, comprising:
a memory storing a program of instructions; and
a processor configured to execute the program of instructions to
obtain a plurality of biometric verifiers, at least one of the biometric verifiers being configured to perform a verification process that terminate at any one of a plurality of successive verification stages, wherein each verification stage of the plurality of successive verification stages corresponds to at least one of a particular verification performance, a particular verification accuracy, and a particular verification speed,
set a termination stage of each biometric verifier of the plurality of biometric verifiers, such that each biometric verifier of the plurality of biometric verifiers is associated with a separate termination stage of a particular combination of termination stages, respectively, wherein the termination stage of each biometric verifier is one of the plurality of successive verification stages,
execute the plurality of biometric verifiers, based on the particular combination of termination stages associated with the plurality of biometric verifiers, to generate a plurality of outputs,
fuse the plurality of outputs based on the particular combination of termination stages associated with the plurality of biometric verifiers to generate a result, and
verify a user based on the result.

### Claim 20 (depends on 19)

The smart phone of claim 19, wherein each biometric verifier is configured to be executed to output an individual verification result through a set of stages of the biometric verifier, the set of stages including at least one stage.
