# US 2023/0066670 A1 · Visual notification of distracted driving

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0066670 A1
- Document ID: US20230066670A1
- Status: Published application
- Kind: A1
- Application number: 17/409,906
- Filed: 2021-08-24
- Published: 2023-03-02
- Earliest claimed: 2021-08-24
- Assignees: Toyota Research Institute, Inc.
- Applicants: Toyota Research Institute, Inc.
- Inventors: Hiroshi Yasuda; Manuel Ludwig Kuehner
- Web page: https://patentgrep.com/patent/US20230066670A1

## CPC

- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/22: Display screens
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/80: Arrangements for controlling instruments
- B60Q 9/00: Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 {, e.g. haptic signalling}
- B60W 40/08: related to drivers or passengers
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06F 3/147: using display panels
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 40/18: Eye characteristics, e.g. of the iris
- G08B 21/06: indicating a condition of sleep, e.g. anti-dozing alarms
- B60K 2360/149: Instrument input by detecting viewing direction not otherwise provided for
- B60K 2360/168: Target or limit values
- B60K 2360/178: Warnings
- B60K 2360/56: using mobile devices
- B60W 2040/0818: {Inactivity or incapacity of driver}
- B60W 2050/146: {Display means}
- B60W 2540/225: Direction of gaze
- B60W 2540/229: Attention level, e.g. attentive to driving, reading or sleeping
- G06T 2207/30196: Human being; Person
- G06T 2207/30268: Vehicle interior
- G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen
- G09G 2354/00: Aspects of interface with display user
- G09G 2380/10: Automotive applications
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A distracted driver can be informed of his or her distraction by a visual notification. It can be detected whether a driver of a vehicle is focused on a non-critical object located within the vehicle. In response to detecting that the driver of the vehicle is focused on a non-critical object located within the vehicle, an amount of time the driver is focused on the non-critical object can be determined. When the amount of time exceeds a threshold amount of time, a visual notification of distracted driving can be caused to be presented on or visually adjacent to the non-critical object.

## Claims

### Claim 1

A distracted driver notification system comprising:
one or more sensors configured to acquire driver gaze data;
one or more processors operatively connected to the one or more sensors, the one or more processors being configured to:
detect, using driver gaze data, whether a driver of a vehicle is focused on a non-critical object located within the vehicle;
responsive to detecting that the driver of the vehicle is focused on a non-critical object located within the vehicle, determining an amount of time the driver is focused on the non-critical object; and
when the amount of time exceeds a threshold amount of time, cause a visual notification of distracted driving to be presented on or visually adjacent to the non-critical object.

### Claim 2 (depends on 1)

The distracted driver notification system of claim 1, wherein the visual notification is presented on one of a display of the non-critical object, a display located visually adjacent to the non-critical object, and a surface located visually on or adjacent to the non-critical object.

### Claim 3 (depends on 1)

The distracted driver notification system of claim 1, wherein the one or more sensors include one or more cameras.

### Claim 4 (depends on 1)

The distracted driver notification system of claim 1, wherein the driver gaze data includes at least one of driver eye position data, driver eye orientation data, driver head position data, and driver head orientation data.

### Claim 5 (depends on 1)

The distracted driver notification system of claim 1, further including a timer, wherein the timer is operatively connected to the one or more processors, and wherein determining an amount of time the driver is focused on the non-critical object includes counting using the timer.

### Claim 6 (depends on 1)

The distracted driver notification system of claim 1, wherein the one or more processors are further configured to:
determine the threshold amount of time based on one or more real-time conditions of a current driving environment of the vehicle.

### Claim 7 (depends on 6)

The distracted driver notification system of claim 6, wherein the one or more real-time conditions include at least one of: speed data, location data, weather data, environment data, or traffic data.

### Claim 8 (depends on 1)

The distracted driver notification system of claim 1, wherein the threshold amount of time is a predetermined amount of time.

### Claim 9 (depends on 1)

The distracted driver notification system of claim 1, wherein the visual notification of distracted driving includes the amount of time the driver is focused on the non-critical object.

### Claim 10 (depends on 1)

The distracted driver notification system of claim 1, wherein the one or more processors are further configured to:
determine whether the non-critical object includes a display; and
responsive to determining that the non-critical object does not include a display, cause the visual notification to be presented on one of: a display located visually adjacent to the non-critical object or a surface located visually adjacent to the non-critical object.

### Claim 11 (depends on 1)

The distracted driver notification system of claim 1, wherein the one or more processors are further configured to:
responsive to detecting that the driver of the vehicle is no longer focused on the non-critical object located within the vehicle, causing the visual notification of distracted driving to be discontinued.

### Claim 12 (depends on 1)

The distracted driver notification system of claim 1, wherein detecting whether the driver of a vehicle is focused on the non-critical object located within the vehicle further includes:
detecting an object in the vehicle; and
determining whether the object is a non-critical object.

### Claim 13 (depends on 1)

The distracted driver notification system of claim 1, wherein cause a visual notification of distracted driving to be presented on or visually adjacent to the non-critical object includes send a command to the non-critical object to present the visual notification of distracted driving on a display of the non-critical object.

### Claim 14

A distracted driver notification method comprising:
detecting whether a driver of a vehicle is focused on a non-critical object located within the vehicle;
responsive to detecting that the driver of the vehicle is focused on a non-critical object located within the vehicle, determining an amount of time the driver is focused on the non-critical object; and
when the amount of time exceeds a threshold amount of time, cause a visual notification of distracted driving to be presented on or visually adjacent to the non-critical object.

### Claim 15 (depends on 14)

The distracted driver notification method of claim 14, wherein cause a visual notification of distracted driving to be presented on or visually adjacent to the non-critical object includes cause a visual notification of distracted driving to be presented on one of: a display of the non-critical object, a display located visually adjacent to the non-critical object, and a surface located on or visually adjacent to the non-critical object.

### Claim 16 (depends on 14)

The distracted driver notification method of claim 14, further including:
acquiring data at least one of driver eye position data, driver eye orientation data, driver head position data, and driver head orientation data, and
wherein detecting whether the driver of a vehicle is focused on the non-critical object located within the vehicle is based on the at least one of driver eye position data, driver eye orientation data, driver head position data, and driver head orientation data.

### Claim 17 (depends on 14)

The distracted driver notification method of claim 14, further including:
determining the threshold amount of time based on real-time conditions of a current driving environment of the vehicle.

### Claim 18 (depends on 14)

The distracted driver notification method of claim 14, further including:
determining whether the non-critical object includes a display; and
responsive to determining that the non-critical object does not include a display, causing the visual notification to be presented on one of a display located visually adjacent to the non-critical object or a surface located visually adjacent to the non-critical object.

### Claim 19 (depends on 14)

The distracted driver notification method of claim 14, further including:
responsive to detecting that the driver of the vehicle is no longer focused on the non-critical object located within the vehicle, causing the visual notification of distracted driving to be discontinued.

### Claim 20 (depends on 14)

The distracted driver notification method of claim 14, wherein detecting whether the driver of a vehicle is focused on the non-critical object located within the vehicle further includes:
detecting an object in the vehicle; and
determining whether the object is a non-critical object.
