# US 2024/0199089 A1 · Device and method for controlling autonomous driving

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0199089 A1
- Document ID: US20240199089A1
- Status: Published application
- Kind: A1
- Application number: 18/353,415
- Filed: 2023-07-17
- Published: 2024-06-20
- Earliest claimed: 2022-12-14
- Assignees: Hyundai Motor Company; Kia Corporation
- Applicants: Hyundai Motor Company; Kia Corporation
- Inventors: Dong Hyuk Kim
- Web page: https://patentgrep.com/patent/US20240199089A1

## CPC

- B60W 40/08: related to drivers or passengers
- B60W 60/0053: {from vehicle to occupant}
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- B60W 2050/146: {Display means}
- B60W 2540/229: Attention level, e.g. attentive to driving, reading or sleeping
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT

## Abstract

An embodiment autonomous driving control device for controlling autonomous driving includes a display device, a sensor device including a sensor, a memory having instructions stored thereon, and a controller operatively connected to the sensor device and the memory, wherein the instructions, when executed by the controller, are configured to cause the autonomous driving control device to obtain state information of a user using the sensor device while controlling a host vehicle based on a specified autonomous driving mode, to determine whether the state information satisfies a specified condition, and to provide a user interface about transfer of a control right of the host vehicle to the user using the display device in response to a determination that the state information satisfies the specified condition.

## Claims

### Claim 1

An autonomous driving control device for controlling autonomous driving, the device comprising:
a display device;
a sensor device comprising a sensor;
a memory having instructions stored thereon; and
a controller operatively connected to the sensor device and the memory, wherein the instructions, when executed by the controller, are configured to cause the autonomous driving control device to:
obtain state information of a user using the sensor device while controlling a host vehicle based on a specified autonomous driving mode;
determine whether the state information satisfies a specified condition; and
provide a user interface about transfer of a control right of the host vehicle to the user using the display device in response to a determination that the state information satisfies the specified condition.

### Claim 2 (depends on 1)

The device of claim 1, wherein the instructions, when executed by the controller, are further configured to cause the autonomous driving control device to determine that the state information satisfies the specified condition and to provide the user interface about the transfer of the control right to the user using the display device in response to a determination, based on the state information, that the user is in a drowsy state.

### Claim 3 (depends on 1)

The device of claim 1, further comprising a communication device, wherein the instructions, when executed by the controller, are further configured to cause the autonomous driving control device to:
determine whether the user is using an external device by utilizing the sensor device in response to a determination that the state information does not satisfy the specified condition;
determine whether the external device is connected to the autonomous driving control device via the communication device in response to a determination that the user is using the external device;
receive information about whether a user input for the external device is received within a specified period of time from the external device in response to a determination that the external device is connected to the autonomous driving control device; and
continuously control the host vehicle based on the specified autonomous driving mode in response to a determination, based on the information, that the user input for the external device is received within the specified period of time.

### Claim 4 (depends on 1)

The device of claim 1, further comprising a communication device, wherein the instructions, when executed by the controller, are further configured to cause the autonomous driving control device to:
determine whether the user is using an external device by utilizing the sensor device in response to a determination that the state information does not satisfy the specified condition;
determine whether the external device is connected to the autonomous driving control device via the communication device in response to a determination that the user is using the external device;
receive information about whether a user input for the external device is received within a specified period of time from the external device in response to a determination that the external device is connected to the autonomous driving control device; and
transmit the user interface about the transfer of the control right to the external device in response to a determination, based on the information, that the user input for the external device is not received within the specified period of time.

### Claim 5 (depends on 4)

The device of claim 4, wherein the instructions, when executed by the controller, are further configured to cause the autonomous driving control device to continuously control the host vehicle based on the specified autonomous driving mode in response to a determination that the user input for the external device is received after transmitting the user interface about the transfer of the control right to the external device.

### Claim 6 (depends on 4)

The device of claim 4, wherein the instructions, when executed by the controller, are further configured to cause the autonomous driving control device to provide the user interface about the transfer of the control right to the user using the display device in response to a determination that the user input for the external device is not received after transmitting the user interface about the transfer of the control right to the external device.

### Claim 7 (depends on 4)

The device of claim 4, wherein the external device comprises a user terminal corresponding to the user.

### Claim 8 (depends on 1)

The device of claim 1, further comprising a communication device, wherein the instructions, when executed by the controller, are further configured to cause the autonomous driving control device to:
determine whether a multimedia device included in the display device is in operation by the user in response to a determination that the state information does not satisfy the specified condition; and
provide the user interface about the transfer of the control right to the user via the multimedia device in response to a determination that the multimedia device is in operation.

### Claim 9 (depends on 8)

The device of claim 8, wherein the instructions, when executed by the controller, are further configured to cause the autonomous driving control device to provide the user interface about the transfer of the control right to the user using an external device other than the multimedia device included in the display device in response to a determination that a user input for the multimedia device is not received after transmitting the user interface about the transfer of the control right to the multimedia device.

### Claim 10 (depends on 1)

The device of claim 1, further comprising a communication device, wherein the instructions, when executed by the controller, are further configured to cause the autonomous driving control device to transmit the user interface about the transfer of the control right to an external device corresponding to the user.

### Claim 11

A method for controlling autonomous driving, the method comprising:
obtaining, by a controller, state information of a user using a sensor device while controlling a host vehicle based on a specified autonomous driving mode;
determining, by the controller, whether the state information satisfies a specified condition; and
providing, by the controller, a user interface about transfer of a control right of the host vehicle to the user using a display device in response to a determination that the state information satisfies the specified condition.

### Claim 12 (depends on 11)

The method of claim 11, wherein providing the user interface to the user comprises determining, by the controller, that the state information satisfies the specified condition and providing the user interface about the transfer of the control right to the user using the display device in response to a determination, based on the state information, that the user is in a drowsy state.

### Claim 13 (depends on 11)

The method of claim 11, further comprising:
determining, by the controller, whether the user is using an external device by utilizing the sensor device in response to a determination that the state information does not satisfy the specified condition;
determining, by the controller, whether the external device is connected to an autonomous driving control device via a communication device in response to a determination that the user is using the external device;
receiving, by the controller, information about whether a user input for the external device is received within a specified period of time from the external device in response to a determination that the external device is connected to the autonomous driving control device; and
continuously controlling, by the controller, the host vehicle based on the specified autonomous driving mode in response to a determination, based on the information, that the user input for the external device is received within the specified period of time.

### Claim 14 (depends on 11)

The method of claim 11, further comprising:
determining, by the controller, whether the user is using an external device by utilizing the sensor device in response to a determination that the state information does not satisfy the specified condition;
determining, by the controller, whether the external device is connected to an autonomous driving control device via a communication device in response to a determination that the user is using the external device;
receiving, by the controller, information about whether a user input for the external device is received within a specified period of time from the external device in response to a determination that the external device is connected to the autonomous driving control device; and
transmitting, by the controller, the user interface about the transfer of the control right to the external device in response to a determination, based on the information, that the user input for the external device is not received within the specified period of time.

### Claim 15 (depends on 14)

The method of claim 14, further comprising continuously controlling, by the controller, the host vehicle based on the specified autonomous driving mode in response to a determination that the user input for the external device is received after transmitting the user interface about the transfer of the control right to the external device.

### Claim 16 (depends on 14)

The method of claim 14, further comprising providing, by the controller, the user interface about the transfer of the control right to the user using the display device in response to a determination that the user input for the external device is not received after transmitting the user interface about the transfer of the control right to the external device.

### Claim 17 (depends on 14)

The method of claim 14, wherein the external device comprises a user terminal corresponding to the user.

### Claim 18 (depends on 11)

The method of claim 11, further comprising:
determining, by the controller, whether a multimedia device included in the display device is in operation by the user in response to a determination that the state information does not satisfy the specified condition; and
providing, by the controller, the user interface about the transfer of the control right to the user via the multimedia device in response to a determination that the multimedia device is in operation.

### Claim 19 (depends on 18)

The method of claim 18, wherein providing the user interface about the transfer of the control right to the user via the multimedia device comprises providing, by the controller, the user interface about the transfer of the control right to the user using an external device other than the multimedia device included in the display device in response to a determination that a user input for the multimedia device is not received after transmitting the user interface about the transfer of the control right to the multimedia device.

### Claim 20 (depends on 11)

The method of claim 11, wherein providing the user interface about the transfer of the control right to the user using the display device comprises transmitting, by the controller, the user interface about the transfer of the control right to an external device corresponding to the user.
