# US 2021/0197831 A1 · Autonomous vehicle control system and autonomous vehicle control method using the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0197831 A1
- Document ID: US20210197831A1
- Status: Published application
- Kind: A1
- Application number: 16/871,985
- Filed: 2020-05-11
- Published: 2021-07-01
- Earliest claimed: 2019-12-27
- Assignees: Hyundai Motor Company; Kia Motors Corporation
- Applicants: Hyundai Motor Company; Kia Motors Corporation
- Inventors: Eun Young CHOI; Min Sang YU; Dong II YANG
- Web page: https://patentgrep.com/patent/US20210197831A1

## CPC

- B60W 40/08: related to drivers or passengers
- G08B 21/06: indicating a condition of sleep, e.g. anti-dozing alarms
- B60W 40/09: Driving style or behaviour
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- B60W 60/00: Drive control systems specially adapted for autonomous road vehicles
- B60W 60/0015: {specially adapted for safety}
- B60W 60/005: {Handover processes (Handing over between remote control and on-board control or handing over between remote control arrangements G05D1/227)}
- G07C 5/0808: {Diagnosing performance data (testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005)}
- G07C 5/0816: {Indicating performance data, e.g. occurrence of a malfunction}
- G08B 21/18: Status alarms (G08B21/02 takes precedence)
- B60W 50/16: Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
- B60W 60/00188: {related to detected security violation of control systems, e.g. hacking of moving vehicle}
- B60W 60/0053: {from vehicle to occupant}
- B60W 2040/0818: {Inactivity or incapacity of driver}
- B60W 2040/0872: {Driver physiology}
- B60W 2050/0072: {Controller asks driver to take over}
- B60W 2050/143: {Alarm means}
- B60W 2050/146: {Display means}
- B60W 2540/229: Attention level, e.g. attentive to driving, reading or sleeping
- G07C 5/008: {communicating information to a remotely located station (transmission systems for measured values G08C)}
- G07C 5/0841: {Registering performance data (recording measured values G01D; information storage G11B)}
- G08B 6/00: Tactile signalling systems, e.g. tactile personal calling systems
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE

## Abstract

An autonomous vehicle may include a driver monitoring device that generates driver monitoring information while driving in an autonomous driving mode, a perception-response feature learning device that measures a perception response time of a driver for each warning notification type based on the driver monitoring information and learns perception response features of the driver based on the measured perception response time of the driver for each warning notification type, a warning notification scenario determining device that determines a customized warning notification scenario for the driver based on of the learned perception response features, and a driver notification providing device that outputs a warning notification based on an output corresponding to each warning notification type, and an autonomous driving information recording device that stores autonomous driving information collected during driving.

## Claims

### Claim 1

An autonomous vehicle comprising:
a driver monitoring device configured to generate driver monitoring information while driving in an autonomous driving mode;
a perception-response feature learning device configured to:
measure a perception response time of a driver for each warning notification type based on the driver monitoring information; and
learn perception response features of the driver based on the measured perception response time of the driver for each warning notification type;
a warning notification scenario determining device configured to determine a customized warning notification scenario for the driver based on the learned perception response features;
a driver notification providing device configured to output a warning notification based on an output corresponding to each warning notification type; and
an autonomous driving information recording device configured to store autonomous driving information collected during driving.

### Claim 2 (depends on 1)

The autonomous vehicle of claim 1, wherein the autonomous driving information recording device includes a first storage device, a second storage device, and a third storage device, and
wherein at least one of the first storage device, the second storage device, or the third storage device is configured to record the autonomous driving information according to an event.

### Claim 3 (depends on 2)

The autonomous vehicle of claim 2, wherein the vehicle further comprises:
a hacking determining device configured to:
determine whether hacking occurs by identifying consistency between a driver monitoring result and a corresponding warning notification output for each warning notification scenario; and
record hacking occurrence information in the second storage device when the hacking is determined to occur.

### Claim 4 (depends on 3)

The autonomous vehicle of claim 3, wherein the hacking occurrence information is transmitted to a central center through a communication network.

### Claim 5 (depends on 2)

The autonomous vehicle of claim 2, wherein the vehicle further comprises:
a driving environment information collecting device configured to collect driving environment information,
wherein the perception-response feature learning device is configured to:
correct the measured perception response time based on the driving environment information; and
learn the perception response features of the driver based on the corrected perception response time.

### Claim 6 (depends on 1)

The autonomous vehicle of claim 1, wherein the warning notification type includes a visual warning notification type, an audible warning notification type and a tactile warning notification type, and
wherein a warning notification message is output according to at least one of the warning notification types in each warning notification scenario.

### Claim 7 (depends on 3)

The autonomous vehicle of claim 3, wherein the vehicle further comprises:
a control switch determining device configured to switch control from a system to the driver when the hacking occurs.

### Claim 8 (depends on 7)

The autonomous vehicle of claim 7, wherein the vehicle further comprises:
a control transfer status identifying device configured to:
determine whether transfer of the control from the system to the driver is normally completed; and
switch the autonomous driving mode to a driver driving mode when it is determined that the transfer of the control from the system to the driver is normally completed.

### Claim 9 (depends on 8)

The autonomous vehicle of claim 8, wherein the control transfer status identifying device is configured to record control transfer failure information in the third storage device when it is determined that the transfer of the control from the system to the driver has failed.

### Claim 10 (depends on 9)

The autonomous vehicle of claim 9, wherein the control transfer status identifying device is configured to transfer the control transfer failure information to a central center through a communication network.

### Claim 11 (depends on 10)

The autonomous vehicle of claim 10, wherein the central center is configured to request emergency measures for the autonomous vehicle from an emergency rescue center when receiving the control transfer failure information.

### Claim 12 (depends on 11)

The autonomous vehicle of claim 11, wherein the central center is configured to provide the failure of the control transfer to the autonomous vehicle or a terminal of the driver when receiving the control transfer failure information.

### Claim 13 (depends on 8)

The autonomous vehicle of claim 8, wherein the vehicle further comprises:
a seat control device configured to:
restore a seat of the autonomous vehicle to a specified position; and
operate a seat belt pretensioner when it is determined that the transfer of the control from the system to the driver has failed.

### Claim 14 (depends on 2)

The autonomous vehicle of claim 2, wherein the vehicle further comprises:
a biometric information collecting device configured to collect driver biometric information,
wherein the first storage device is configured to:
record driving environment information and the driver biometric information; and
transmit the driving environment information and the driver biometric information to a central center when driver distraction is detected based on the driver monitoring information.

### Claim 15 (depends on 14)

The autonomous vehicle of claim 14, wherein the central center is configured to receive the driving environment information and the driver biometric information through a communication network.

### Claim 16 (depends on 14)

The autonomous vehicle of claim 14, wherein the driver biometric information includes at least one of facial recognition information, pulse information, pupil tracking information, information on respiration number per unit time, electrocardiogram information, body temperature information, electroencephalogram information, or skin electroconductive information, and
wherein the driving environment information includes at least one of current time zone information, current location information, driving road information, driving line information, driving speed information, speed limit information of a road on which the autonomous vehicle is driving, indoor and outdoor vehicle video image information, or ambient noise information.

### Claim 17

An autonomous vehicle control method in an autonomous vehicle, comprising:
collecting driver monitoring information while driving in an autonomous driving mode;
measuring a perception-response time of a driver for each warning notification type based on the driver monitoring information;
learning perception-response features of the driver based on the measured perception-response time of the driver for each warning notification type;
determining a customized warning notification scenario for the driver based on the learned perception-response features; and
recording autonomous driving information collected during driving in an autonomous driving information recording device provided in the autonomous vehicle.

### Claim 18 (depends on 17)

The autonomous vehicle control method of claim 17, wherein the method further comprises:
determining whether hacking occurs by identifying consistency between a driver monitoring result and a corresponding warning notification output for each warning notification scenario; and
recording hacking occurrence information in a second storage device when the hacking is determined to occur.

### Claim 19 (depends on 17)

The autonomous vehicle control method of claim 17, wherein the method further comprises:
collecting driving status information;
storing the driving status information in the autonomous driving information recording device;
correcting the measured perception-response time based on the driving status information; and
learning the perception-response features of the driver based on the corrected perception-response time.

### Claim 20 (depends on 18)

The autonomous vehicle control method of claim 18, wherein the method further comprises:
outputting a predetermined warning notification informing the driver of a need for a transfer of a control from a system to the driver when the hacking is determined to occur.

### Claim 21 (depends on 20)

The autonomous vehicle control method of claim 20, wherein the method further comprises:
recoding control transfer failure information in the autonomous driving information recording device when the transfer of the control has failed from the system to the driver.

### Claim 22 (depends on 17)

The autonomous vehicle control method of claim 17, wherein the method further comprises:
detecting driver distraction based on the driver monitoring information;
collecting driver biometric information and driving environment information when the driver distraction is detected;
recording the driver biometric information and the driving environment information in the autonomous driving information recording device; and
transmitting, to a central center, the driver biometric information and the driving environment information.

### Claim 23

An autonomous vehicle control method comprising:
detecting an event while driving in an autonomous driving mode;
identifying a class of the detected event;
classifying information related to the detected event according to the class of the identified event and storing the information related to the detected event in an autonomous driving information recording device;
transmitting the information related to the detected event to a central center when the class of the identified event corresponds to a preset level; and
not transmitting the information related to the detected event to the central center when the class of the identified event does not correspond to the preset level.

### Claim 24 (depends on 23)

The autonomous vehicle control method of claim 23, wherein the event while driving in the autonomous driving mode includes at least one of a hacking occurrence event, a control transfer failure event, a vehicle failure event, or a driver distraction event.

### Claim 25 (depends on 23)

The autonomous vehicle control method of claim 23, wherein the preset level is set in advance based on at least one of reliability, stability, or importance of the information related to the detected event.

### Claim 26 (depends on 23)

The autonomous vehicle control method of claim 23, wherein the classification and storing of the information further includes:
classifying the information related to the detected event according to the class of the identified event and storing the classified information in a plurality of storage devices, wherein the autonomous driving information recording devices comprises the plurality of storage devices.

### Claim 27

An autonomous vehicle comprising:
an autonomous driving information recording device configured to store autonomous driving information collected during driving, and
a control device configured to:
classify information related to a detected event according to a class identified corresponding to the detected event;
store the information in the autonomous driving information recording device when the event is detected while driving in an autonomous driving mode;
transmit the information related to the detected event when the identified class corresponds to a preset class; and
not transmit the information related to the detected event when the identified class does not correspond to the preset class.

### Claim 28 (depends on 27)

The autonomous vehicle control method of claim 27, wherein the event while driving in the autonomous driving mode includes at least one of a hacking occurrence event, a control transfer failure event, a vehicle failure event, or a driver distraction event.

### Claim 29 (depends on 27)

The autonomous vehicle control method of claim 27, wherein the preset level is set in advance based on at least one of reliability, stability, or importance of the information related to the detected event.

### Claim 30 (depends on 27)

The autonomous vehicle control method of claim 27, the control device is configured to:
classify information related to the detected event according to a class of the identified event and store the information in a plurality of storage devices, wherein the autonomous driving information recording device comprises the plurality of storage devices.
