# US 2021/0331647 A1 · In-vehicle complex biometric authentication system and operation method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0331647 A1
- Document ID: US20210331647A1
- Status: Published application
- Kind: A1
- Application number: 16/488,183
- Filed: 2019-03-18
- Published: 2021-10-28
- Earliest claimed: 2019-03-18
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Kokeun KIM; Jihye KIM; Sooyoung SIM; Beomoh KIM; Sungjin KIM
- Web page: https://patentgrep.com/patent/US20210331647A1

## CPC

- B60R 25/25: using biometry
- B60R 25/34: of conditions of vehicle components, e.g. of windows, door locks or gear selectors
- B60W 40/08: related to drivers or passengers
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V 40/1365: {Matching; Classification}
- G06V 40/172: {Classification, e.g. identification}
- G06V 40/50: Maintenance of biometric data or enrolment thereof
- G06V 40/70: Multimodal biometrics, e.g. combining information from different biometric modalities
- B60W 2040/0809: {Driver authorisation; Driver identity check}
- B60W 2040/0872: {Driver physiology}
- B60W 2040/0881: {Seat occupation; Driver or passenger presence}
- B60W 2040/089: {Driver voice}
- B60W 2540/30: Driving style
- B60W 2556/10: Historical data
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An in-vehicle complex biometric authentication system includes: a sensor to sense a driver's boarding of a vehicle; a controller to perform driver authentication based on biometric information sensed by multiple biometric sensors when driver's boarding in a vehicle is detected by the sensor, and to collect driver's identification information and driving habit information during operation of a vehicle when the driver authentication is succeeded; and a memory to store the identification information and driving habit information as implicit authentication information, wherein the controller further detects situation recognition information related to the implicit authentication information, after the driver authentication is succeeded, and determines whether to perform additional authentications based on the matching result of the detected situation recognition information with the implicit authentication information. According the present invention, the system can provide a biometric authentication system to which the IOT is applied.

## Claims

### Claim 1

An in-vehicle complex biometric authentication system, comprising:
a sensor configured to sense vehicle boarding of a driver;
a controller configured to perform driver authentication based on biometric information sensed by multiple biometric sensors when driver's boarding in a vehicle is detected by the sensor, and to collect driver's identification information and drive habit information during operation of a vehicle when the driver's authentication is succeeded; and
a memory configured to store the identification information and driving habit information as implicit authentication information,
wherein the controller is further configured to detect situation recognition information related to the implicit authentication information, after the driver authentication is succeeded, and to determine whether to perform additional authentications based on the matching result of the detected situation recognition information with the implicit authentication information.

### Claim 2 (depends on 1)

The in-vehicle complex biometric authentication system of claim 1, wherein the controller is configured to output signals related to the initiation of a vehicle operation when the driver's authentication is succeeded.

### Claim 3 (depends on 1)

The in-vehicle complex biometric authentication system of claim 1, further comprising an output unit configured to output a first notification to indicate the failure of the driver authentication and a second notification to indicate the failure of initiation of the vehicle's operation when the driver authentication is failed.

### Claim 4 (depends on 1)

The in-vehicle complex biometric authentication system of claim 1, wherein the situation recognition information related to the implicit authentication information is detected by analyzing driver identification-related information and driving habit-related data acquired using at least one sensor equipped in a vehicle, during operation of a vehicle after success of driver authentication.

### Claim 5 (depends on 4)

The in-vehicle complex biometric authentication system of claim 4, wherein the controller is configured to, when an opening or closing of a vehicle door is sensed, determine whether the authentication status is maintained and whether additional authentications are performed, based on the matching results of the situation recognition information detected using the at least one sensor with the implicit authentication information.

### Claim 6 (depends on 5)

The in-vehicle complex biometric authentication system of claim 5, wherein the controller is configured to maintain the authentication status when the level of matching the identification information and driving habit information corresponding to the detected situation recognition information with the stored implicit authentication information is higher than a first reference range, to release the authentication status and output a request for further authentication based on biometric information when the inconsistency degree of matching the identification information and driving habit information corresponding to the detected situation recognition information with the stored implicit authentication information is below a second reference range.

### Claim 7 (depends on 6)

The in-vehicle complex biometric authentication system of claim 6, wherein the controller is configured to output a signal that, after the release of the authentication status, ceases to start the vehicle until further authentication succeeds upon request to perform further authentication.

### Claim 8 (depends on 6)

The in-vehicle complex biometric authentication system of claim 6, wherein the controller is configured to update the implicit authentication information by collecting the driver identification information and driving habit information recorded after the success of driver authentication under additional authentication.

### Claim 9 (depends on 1)

The in-vehicle complex biometric authentication system of claim 1, further comprising a position calculation unit that calculates the position of the vehicle, and
wherein the controller is configured to determine whether to perform additional authentications based on the matching results of the situation recognition information detected before and after recognition with the stored implicit authentication information, when the position of the vehicle is perceived to be located in a designated location.

### Claim 10 (depends on 1)

The in-vehicle complex biometric authentication system of claim 1, wherein the situation recognition information related to the implicit authentication information includes identification information and driving habit information newly collected after driver authentication, and
wherein the controller is configured to periodically perform matching the newly collected identification information and driving habit information with the implicit authentication information.

### Claim 11 (depends on 10)

The in-vehicle complex biometric authentication system of claim 10, wherein the identification information includes at least part of a plurality of biometric information or other biometric information than the plurality of biometric information,
wherein the driving habit information includes multiple driving-related behavioral items, and
wherein the multiple driving-related behavioral items include at least part of the quantity of driver's utterance recorded during the operation of vehicle, an average driving speed, a grip position of a handle, a pressure level applied to a handle, a rotational speed of a handle, and a pressure level applied to an acceleration pedal.

### Claim 12 (depends on 10)

The in-vehicle complex biometric authentication system of claim 10, wherein the controller is configured to calculate a matching score by the biometric information corresponding to the identification information and multiple driving-related behavioral items with respect to the detected situation recognition information, and determine whether to maintain driver authentication using the calculated matching score.

### Claim 13 (depends on 1)

The in-vehicle complex biometric authentication system of claim 1, wherein the controller is configured to perform other person driving mode when a preset input is received after success of the driver authentication, and to perform registration of a new driver based on biometric information acquired through at least one of the multiple biometric sensors depending on the performance of the other person driving mode, and
wherein the detection of situation recognition information related to implicit authentication information is limited in the other person driving mode.

### Claim 14 (depends on 13)

The in-vehicle complex biometric authentication system of claim 13, wherein the controller is configured to release registration of a new driver when opening and closing of the vehicle door is detected in the other person driving mode, to detect situation recognition information related to implicit authentication, and to determine whether to maintain the authentication status of the driver authentication based on the detected situation recognition information.

### Claim 15

An operation method of an in-vehicle complex biometric system, comprising:
detecting driver's boarding in a vehicle using sensors equipped in the vehicle;
performing driver authentication based on biometric information detected using multiple biometric sensors when the driver's boarding in a vehicle is detected;
collecting driver's identification information and driving habit information during operation of the vehicle when the driver authentication succeeded and storing the collected identification information and driving habit information as implicit authentication information; and
determining whether to perform additional authentications based on the matching result of the detected situation recognition information with the stored implicit authentication information when situation recognition information related to the implicit authentication information is detected after success of the driver authentication.

### Claim 16

A vehicle terminal, comprising:
a communication unit configured to receive biometric information from multiple biometric sensors equipped in a vehicle when a driver's boarding in a vehicle is detected;
a controller configured to perform driver authentication based on the received biometric information, and collect driver's identification information and driving habit information when the driver authentication is succeeded; and
a memory configured to store the collected identification information and driving habit information as implicit authentication information,
wherein the controller is further configured to, after success of the driver authentication, detect situation recognition information related to the implicit authentication information and to determine whether to perform additional authentications based on the matching results of the detected situation recognition information with the implicit authentication information.
