# US 2020/0402267 A1 · Driving support device, driving support method, and storage medium storing driving support program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0402267 A1
- Document ID: US20200402267A1
- Status: Published application
- Kind: A1
- Application number: 17/012,804
- Filed: 2020-09-04
- Published: 2020-12-24
- Earliest claimed: 2018-03-12
- Assignees: Mitsubishi Electric Corporation
- Applicants: Mitsubishi Electric Corporation
- Inventors: Jumpei HATO
- Web page: https://patentgrep.com/patent/US20200402267A1

## CPC

- G06T 11/00: Two-dimensional [2D] image generation
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/22: Display screens
- B60K 35/231: characterised by their arrangement or structure for integration into vehicles
- B60K 35/235: with means for detecting the driver's gaze direction or eye points
- B60K 35/285: {for improving awareness by directing driver's gaze direction or eye points}
- B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10)
- B60K 35/81: for controlling displays
- B60K 37/20: Dashboard panels
- B60Q 9/008: {for anti-collision purposes}
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G08G 1/167: {Driving aids for lane monitoring, lane changing, e.g. blind spot detection}
- G09G 5/37: Details of the operation on graphic patterns (G09G5/38 takes precedence)
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 2360/177: Augmented reality
- B60K 2360/178: Warnings
- G09G 2354/00: Aspects of interface with display user
- G09G 2380/10: Automotive applications
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A driving support device includes processing circuitry to judge a target object that is a real object existing in the vicinity of the vehicle and should be paid attention to by the driver; to generate a visual attraction stimulation image that appears to move from a position farther than the target object towards a position where the target object exists; to cause a display device to display the visual attraction stimulation image; and to receive body information from a body information detector acquiring the body information on the driver, to calculate a value indicating body reaction to visual stimulation sensed by the driver, and to correct a display parameter that determines display condition of the visual attraction stimulation image based on the value indicating the body reaction so as to change a degree of the visual stimulation given to the driver by the visual attraction stimulation image.

## Claims

### Claim 1

A driving support device for supporting driving performed by a driver of a vehicle, comprising:
processing circuitry
to judge a target object that is a real object existing in a vicinity of the vehicle and should be paid attention to by the driver based on vicinity information acquired by a vicinity detector that captures an image of or detects a real object existing in the vicinity of the vehicle;
to generate a visual attraction stimulation image that appears to move from a position farther than the target object towards a position where the target object exists;
to cause a display device that displays an image in superimposition on the real object to display the visual attraction stimulation image; and
to receive body information from a body information detector acquiring the body information on the driver, to calculate a value indicating body reaction to visual stimulation sensed by the driver from the body information, and to correct a display parameter that determines display condition of the visual attraction stimulation image based on the value indicating the body reaction so as to change a degree of the visual stimulation given to the driver by the visual attraction stimulation image.

### Claim 2 (depends on 1)

The driving support device according to claim 1, wherein the processing circuitry starts the movement of the visual attraction stimulation image at the position farther than the target object and ends the movement of the visual attraction stimulation image at the position where the target object exists.

### Claim 3 (depends on 1)

The driving support device according to claim 1, wherein the value indicating the body reaction includes at least one of a body reaction probability indicating a probability of existence of the body reaction and a body reaction level indicating a level of the body reaction.

### Claim 4 (depends on 1)

The driving support device according to claim 1, wherein the processing circuitry corrects the display parameter so as to reduce the visual stimulation given to the driver by the visual attraction stimulation image when the value indicating the body reaction is greater than or equal to a predetermined first threshold value.

### Claim 5 (depends on 1)

The driving support device according to claim 1, wherein the processing circuitry corrects the display parameter so as to strengthen the visual stimulation given to the driver by the visual attraction stimulation image when the value indicating the body reaction is less than a predetermined second threshold value.

### Claim 6 (depends on 1)

The driving support device according to claim 1, wherein the processing circuitry does not correct the display parameter when the value indicating the body reaction is less than a predetermined second threshold value.

### Claim 7 (depends on 1)

The driving support device according to claim 1, wherein the processing circuitry includes a body reaction measurer that calculates the value indicating the body reaction based on a result of measuring a change in one or more of facial expression, muscle tonus, a flexor reflex, a heart rate, a blood pressure value, a line of sight and driving action of the driver.

### Claim 8 (depends on 1)

The driving support device according to claim 1, wherein the processing circuitry determines a visual attraction stimulation image from which the driver sensed visual stimulation by using an elapsed time from a time point when the visual attraction stimulation image is presented to appearance of a change in the body information on the driver and corrects the display parameter of the visual attraction stimulation image.

### Claim 9 (depends on 1)

The driving support device according to claim 1, wherein the processing circuitry
determines a weight value corresponding to a viewpoint vector of the driver based on the viewpoint vector at a time when the visual attraction stimulation image is presented, and
uses the weight value in the correction of the display parameter.

### Claim 10 (depends on 1)

The driving support device according to claim 1, wherein the processing circuitry performs adjustment of the display parameter by using one or more of a moving speed of the visual attraction stimulation image, a moving distance of the visual attraction stimulation image, a moving direction of the visual attraction stimulation image, and a weight value based on a viewpoint vector.

### Claim 11 (depends on 1)

The driving support device according to claim 1, wherein
when strengthening the visual stimulation given by the visual attraction stimulation image, the processing circuitry performs one or more of increasing a moving speed of the visual attraction stimulation image, increasing a moving distance of the visual attraction stimulation image, and making a moving direction of the visual attraction stimulation image closer to a direction heading towards the vehicle, and
when inhibiting the visual stimulation given by the visual attraction stimulation image, the processing circuitry performs one or more of decreasing the moving speed of the visual attraction stimulation image, decreasing the moving distance of the visual attraction stimulation image, and making the moving direction of the visual attraction stimulation image closer to a direction heading towards a position separate from the vehicle.

### Claim 12

A driving support method of supporting driving performed by a driver of a vehicle, comprising:
judging a target object that is a real object existing in a vicinity of the vehicle and should be paid attention to by the driver based on vicinity information acquired by a vicinity detector that captures an image of or detects a real object existing in the vicinity of the vehicle;
generating a visual attraction stimulation image that appears to move from a position farther than the target object towards a position where the target object exists;
causing a display device that displays an image in superimposition on the real object to display the visual attraction stimulation image; and
receiving body information from a body information detector that acquires the body information on the driver, calculating a value indicating body reaction to visual stimulation sensed by the driver from the body information, and correcting a display parameter that determines display condition of the visual attraction stimulation image based on the value indicating the body reaction so as to change a degree of the visual stimulation given to the driver by the visual attraction stimulation image.

### Claim 13

A non-transitory computer-readable storage medium storing a driving support program for supporting driving performed by a driver of a vehicle, wherein the driving support program causes a computer to execute processing comprising:
judging a target object that is a real object existing in a vicinity of the vehicle and should be paid attention to by the driver based on vicinity information acquired by a vicinity detector that captures an image of or detects a real object existing in the vicinity of the vehicle;
generating a visual attraction stimulation image that appears to move from a position farther than the target object towards a position where the target object exists;
causing a display device that displays an image in superimposition on the real object to display the visual attraction stimulation image; and
receiving body information from a body information detector that acquires the body information on the driver, calculating a value indicating body reaction to visual stimulation sensed by the driver from the body information, and correcting a display parameter that determines display condition of the visual attraction stimulation image based on the value indicating the body reaction so as to change a degree of the visual stimulation given to the driver by the visual attraction stimulation image.
