# US 2022/0032942 A1 · Information providing device and information providing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0032942 A1
- Document ID: US20220032942A1
- Status: Published application
- Kind: A1
- Application number: 17/278,732
- Filed: 2018-10-16
- Published: 2022-02-03
- Earliest claimed: 2018-10-16
- Assignees: Mitsubishi Electric Corporation
- Applicants: Mitsubishi Electric Corporation
- Inventors: Takumi TAKEI
- Web page: https://patentgrep.com/patent/US20220032942A1

## CPC

- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G08G 1/166: {for active traffic, e.g. moving vehicles, pedestrians, bikes}
- B60W 40/08: related to drivers or passengers
- B60W 40/09: Driving style or behaviour
- B60W 50/16: Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
- B60W 60/0013: {specially adapted for occupant comfort}
- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- G06V 40/174: {Facial expression recognition}
- B60W 2040/0872: {Driver physiology}
- B60W 2040/089: {Driver voice}
- B60W 2050/143: {Alarm means}
- B60W 2050/146: {Display means}
- B60W 2540/21: Voice
- B60W 2540/22: Psychological state; Stress level or workload
- B60W 2540/221: Physiology, e.g. weight, heartbeat, health or special needs
- B60W 2540/225: Direction of gaze
- B60W 2540/229: Attention level, e.g. attentive to driving, reading or sleeping
- B60W 2554/00: Input parameters relating to objects
- B60W 2556/10: Historical data
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A confusion degree determining unit determines a degree of confusion of an occupant by using occupant state information acquired by an occupant state acquiring unit. A recognition degree determining unit determines a degree of recognition of the occupant, with respect to surrounding conditions and automatic control of a vehicle, by using surrounding condition information and control information acquired by a host vehicle status acquiring unit and the occupant state information acquired by the occupant state acquiring unit. An information generation unit generates information to be provided to the occupant by using the surrounding condition information and control information acquired by the host vehicle status acquiring unit, the degree of confusion determined by the confusion degree determining unit, and the degree of recognition determined by the recognition degree determining unit.

## Claims

### Claim 1

An information providing device comprising:
a processor to execute a program; and
a memory to store the program which, when executed by the processor, performs processes of,
acquiring first information indicating surrounding conditions of a vehicle and second information regarding automatic control of the vehicle;
acquiring third information indicating a state of an occupant of the vehicle;
determining a degree of confusion of the occupant by using the third information acquired by the occupant state acquiring unit;
determining a degree of recognition of the occupant, with respect to the surrounding conditions and the automatic control of the vehicle, by using the first information, the second information, and the third information acquired; and
generating information to be provided to the occupant by using the first information and the second information acquired, the degree of confusion determined, and the degree of recognition determined.

### Claim 2 (depends on 1)

The information providing device according to claim 1, wherein the processes further include increasing or decreasing an amount of the information to be provided to the occupant depending on the degree of confusion determined or the degree of recognition determined.

### Claim 3 (depends on 2)

The information providing device according to claim 2, wherein the processes further include increasing the amount of the information to be provided to the occupant as the degree of confusion determined is higher, or as the degree of recognition determined is lower.

### Claim 4 (depends on 1)

The information providing device according to claim 1, wherein the processes further include determining the degree of confusion of the occupant by using the third information which indicates at least one of the occupant's facial expression, line of sight, behavior, voice, heart rate, sweat rate, or number of rides, and which is acquired.

### Claim 5 (depends on 1)

The information providing device according to claim 1, wherein the processes further include estimating a current degree of confusion by using a history of past determination of a degree of confusion performed for the occupant.

### Claim 6 (depends on 1)

The information providing device according to claim 1, wherein the processes further include
determining a matter recognized by the occupant, in the surrounding conditions and the automatic control of the vehicle, and
generating information regarding the surrounding conditions and the automatic control of the vehicle which are other than the matter determined to be recognized by the occupant.

### Claim 7 (depends on 1)

The information providing device according to claim 1, wherein the processes further include generating the information to be provided to the occupant by using the first information and the second information acquired, the degree of confusion determined, and the degree of recognition determined, and providing the generated information to the occupant, and then, when a degree of confusion newly determined does not decrease by greater than or equal to a predetermined value, increasing an amount of information to be provided to the occupant.

### Claim 8 (depends on 1)

The information providing device according to claim 1, wherein the information to be provided to the occupant does not change when the degree of confusion of the occupant is increased due to a conversation with another occupant.

### Claim 9

An information providing method comprising:
acquiring first information indicating surrounding conditions of a vehicle and second information regarding automatic control of the vehicle;
acquiring third information indicating a state of an occupant of the vehicle;
determining a degree of confusion of the occupant by using the third information acquired;
determining a degree of recognition of the occupant, with respect to the surrounding conditions and the automatic control of the vehicle, by using the first information, the second information, and the third information acquired; and
generating information to be provided to the occupant by using the first information and the second information acquired, the degree of confusion determined, and the degree of recognition determined.
