# US 2020/0391591 A1 · Vehicle and control method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0391591 A1
- Document ID: US20200391591A1
- Status: Published application
- Kind: A1
- Application number: 16/705,707
- Filed: 2019-12-06
- Published: 2020-12-17
- Earliest claimed: 2019-06-17
- Assignees: Hyundai Motor Company; Kia Motors Corporation
- Applicants: Hyundai Motor Company; Kia Motors Corporation
- Inventors: EUNGSEO KIM; Tae Young LEE; Sangmin LEE; DongHyun SUNG; Yongseok KWON
- Web page: https://patentgrep.com/patent/US20200391591A1

## CPC

- B60W 30/08: {Active safety systems} predicting or avoiding probable or impending collision {or attempting to minimise its consequences}
- B60W 30/085: Taking automatic action to adjust vehicle attitude in preparation for collision, e.g. braking for nose dropping
- B60W 30/09: Taking automatic action to avoid collision, e.g. braking and steering
- B60W 30/0956: {the prediction being responsive to traffic or environmental parameters}
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G08G 1/16: Anti-collision systems (road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08)
- B60K 28/066: {actuating a signalling device (B60K28/063 takes precedence)}
- B60W 40/09: Driving style or behaviour
- B60W 2040/0863: {due to erroneous selection or response of the driver}
- B60W 2050/143: {Alarm means}
- B60W 2540/225: Direction of gaze
- B60W 2554/80: Spatial relation or speed relative to objects
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES

## Abstract

A vehicle includes an internal camera configured to acquire the driver's facial data to identify the driver's gaze region; an external sensor configured to acquire object data including at least one of a relative position and a relative speed of the object existing in all directions of the vehicle; and a controller configured to generate an advance warning signal.

## Claims

### Claim 1

A vehicle comprising:
an internal camera configured to acquire facial data of a driver to identify the driver's gaze region;
an external sensor configured to acquire object data of an object, the object data including at least one of a relative position and a relative speed of the object existing in all directions of the vehicle; and
a controller configured to
determine a possibility of collision between the vehicle and the object based on the object data,
generate a control command for performing at least one of a braking control and a steering control to avoid a collision between the vehicle and the object at a second time point,
generate a warning signal transmitted at the second time point when the object is present in the gaze region of the driver and
generate an advance warning signal transmitted at a first time point that is earlier than the second time point when the object is not present in the gaze region of the driver.

### Claim 2 (depends on 1)

The vehicle of claim 1, wherein when the object exists in the gaze region of the driver, the controller is configured to determine that the driver recognizes the object and does not generate the advance warning signal before the second time point.

### Claim 3 (depends on 1)

The vehicle of claim 1, wherein when the object does not exist in the gaze region of the driver, the controller is configured to determine that the driver does not recognize the object, and generate the advance warning signal to avoid a collision with the object through manual operation of the driver at the first time point.

### Claim 4 (depends on 1)

The vehicle of claim 1, wherein, the controller is configured to determine a center point of viewing zone of the driver, calculate a recognition index on the basis of a driver gaze distribution function and gaze holding time based on the center point, and determine at least a portion of the viewing zone as the gaze region when the recognition index is greater than or equal to a predetermined value.

### Claim 5 (depends on 1)

The vehicle of claim 1, wherein, the internal camera is configured acquire the facial data including at least one of a face direction of the driver and a pupil direction of the driver, and the controller is configured to determine whether the gaze region of the driver belongs to a first area, a second area, or a third area and determine the presence of the object among the first area, the second area, and the third area, and
wherein the first area is an area including a driver's side window and a left side mirror, the second area is an area including a driving lane and a cluster of the vehicle, and the third area is an area including room mirror, a passenger side window and a right side mirror.

### Claim 6 (depends on 5)

The vehicle of claim 5, wherein, the controller is configured to detect that the object exists in front of the vehicle, and generate the advance warning signal to avoid collision with the object when determining that the driver's gaze region belongs to the first area or the third area.

### Claim 7 (depends on 5)

The vehicle of claim 5, wherein, the controller is configured to detect that the object exists in the left rear side of the vehicle, and generate the advance warning signal to avoid collision with the object when determining that the driver's gaze region belongs to the third area.

### Claim 8 (depends on 5)

The vehicle of claim 5, wherein, the controller is configured to detect that the object exists in the right rear side of the vehicle, and generate the advance warning signal to avoid collision with the object when determining that the driver's gaze region belongs to the third area.

### Claim 9 (depends on 1)

The vehicle of claim 1, wherein, when the object is not in the viewing zone of the driver, the controller is configured to calculate a gaze movement time for moving the center point of the viewing zone of the driver to the object and a avoidance control time for the driver to sense the object and avoid collision, and generate the advance warning signal at a first time point at which the gaze movement time and the avoidance control time are secured.

### Claim 10 (depends on 1)

The vehicle of claim 1, wherein, the advance warning signal includes a display and a warning sound generated by an HMI (Human Machine Interface) provided in the vehicle and a vibration generated by the haptic module provided in the vehicle.

### Claim 11

A method for controlling a vehicle equipped with an internal camera and an external sensor, the method comprising:
acquiring facial data of a driver to identify a driver's gaze region;
acquiring object data of an object, the object data including at least one of a relative position and a relative speed of the object existing in all directions of the vehicle; and
generating an advance warning signal based on the facial data and the object data,
wherein the generating of the advance warning signal, comprising:
determining a possibility of collision between the vehicle and the object based on the object data;
generating a control command for performing at least one of braking control and steering control to avoid a collision between the vehicle and the object at a second time point;
generating a warning signal transmitted at the second time point when the object is present in the gaze region of the driver; and
generating an advance warning signal transmitted at a first time point earlier than the second time point when the object is not present in the driver's gaze region.

### Claim 12 (depends on 11)

The method of claim 11, wherein, when the object exists within the gaze region of the driver, the generating of the advance warning signal includes determining that the driver has recognized the object and not generating the advance warning signal before the second time point.

### Claim 13 (depends on 11)

The method of claim 11, wherein, when the object does not exist within the gaze region of the driver, the generating of the advance warning signal includes determining that the driver does not recognize the object, and generating the advance warning signal to avoid a collision with the object through manual operation of the driver at the first time point.

### Claim 14 (depends on 11)

The method of claim 11, wherein, the generating of the advance warning signal includes determining a center point of viewing zone of the driver, calculating a recognition index on the basis of a driver gaze distribution function and gaze holding time based on the center point, and determining at least a portion of the viewing area as the gaze region when the recognition index is greater than or equal to a predetermined value.

### Claim 15 (depends on 11)

The method of claim 11, wherein, the internal camera acquires the facial data including at least one of a face direction of the driver and a pupil direction of the driver, and
the generating of the advance warning signal includes determining whether the gaze region of the driver belongs to a first area, a second area, or a third area and determining the presence of the object among the first area, the second area, and the third area,
wherein the first area is an area including a driver's side window and a left side mirror, the second area is an area including a driving lane and a cluster of the vehicle, and the third area is an area including room mirror, a passenger side window and a right side mirror.

### Claim 16 (depends on 15)

The method of claim 15, wherein, the generating of the advance warning signal includes detecting that the object exists in front of the vehicle, and generating the advance warning signal to avoid collision with the object when determining that the driver's gaze region belongs to the first area or the third area.

### Claim 17 (depends on 15)

The method of claim 15, wherein, the generating of the advance warning signal includes detecting that the object exists in the left rear side of the vehicle, and generating the advance warning signal to avoid collision with the object when determining that the driver's gaze region belongs to the third area.

### Claim 18 (depends on 15)

The method of claim 15, wherein the generating of the advance warning signal includes detecting that the object exists in the right rear side of the vehicle, and generating the advance warning signal to avoid collision with the object when determining that the driver's gaze region belongs to the third area.

### Claim 19 (depends on 11)

The method of claim 11, wherein the object is not in the viewing zone of the driver, the generating of the advance warning signal includes calculating a gaze movement time for moving the center point of the viewing zone of the driver to the object and a avoidance control time for the driver to sense the object and avoid collision, and generating the advance warning signal at a first time point at which the gaze movement time and the avoidance control time are secured.

### Claim 20 (depends on 11)

The method of claim 11, wherein the advance warning signal includes a display and a warning sound generated by an HMI (Human Machine Interface) provided in the vehicle and a vibration generated by the haptic module provided in the vehicle.
