# US 2018/0024627 A1 · Automatic pause and resume of media content during automated driving based on driver's gaze

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0024627 A1
- Document ID: US20180024627A1
- Status: Published application
- Kind: A1
- Application number: 15/214,641
- Filed: 2016-07-20
- Published: 2018-01-25
- Earliest claimed: 2016-07-20
- Assignees: Toyota Motor Engineering & Manufacturing North America, Inc.
- Applicants: Toyota Motor Engineering & Manufacturing North America, Inc.
- Inventors: John-Michael McNew
- Web page: https://patentgrep.com/patent/US20180024627A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/22: Display screens
- B60K 35/81: for controlling displays
- G09G 5/003: {Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto (specific for a CRT G09G1/165; for a flat panel G09G3/2092)}
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/285: {for improving awareness by directing driver's gaze direction or eye points}
- B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
- B60K 35/654: {the user being the driver}
- B60K 2360/149: Instrument input by detecting viewing direction not otherwise provided for
- B60K 2360/195: Blocking or enabling display functions
- G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T)
- G09G 2354/00: Aspects of interface with display user
- G09G 2380/10: Automotive applications
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A gaze safety module is described herein. In an embodiment, the gaze safety module may comprise a gaze area classifier, a monitoring needs estimator, and a display control. The gaze area classifier may be configured to: receive first sensor data from a sensor; and determine a first gaze classification of a driver based, at least in part, on the first sensor data. The monitoring needs estimator may be configured to: receive driving condition data; and determine one or more gaze requirements. The display control may be configured to: pause playback of a media player based, at least in part, on the first gaze classification and the one or more gaze requirements; and determine a first value for a resume type variable based, at least in part, on the first gaze classification and the one or more gaze requirements.

## Claims

### Claim 1

A gaze safety module comprising:
a gaze area classifier configured to:
receive first sensor data from a sensor; and
determine a first gaze classification of a driver based, at least in part, on the first sensor data;
a monitoring needs estimator configured to:
receive driving condition data; and
determine one or more gaze requirements;
a display control configured to:
pause playback of a media player based, at least in part, on the first gaze classification and the one or more gaze requirements; and
determine a first value for a resume type variable based, at least in part, on the first gaze classification and the one or more gaze requirements.

### Claim 2 (depends on 1)

The gaze safety module of claim 1, wherein the one or more gaze requirements comprises an on-road glance frequency, the first gaze classification is on-device, and the first value indicates immediate.

### Claim 3 (depends on 1)

The gaze safety module of claim 1, wherein the one or more gaze requirements comprises an on-road glance time, the first gaze classification is on-device, and the first value indicates immediate.

### Claim 4 (depends on 1)

The gaze safety module of claim 1, wherein the one or more gaze requirements comprises an away glance frequency, the first gaze classification is away, and the first value indicates delayed.

### Claim 5 (depends on 1)

The gaze safety module of claim 1, wherein:
the gaze area classifier is further configured to:
receive second sensor data from the sensor; and
determine a second gaze classification of the driver based, at least in part, on the second sensor data; and
the display control further configured to:
determine a resume delay based, at least in part, on the first value; and
resume playback of the media player based, at least in part, on the second gaze classification, the one or more gaze requirements, and the first value.

### Claim 6 (depends on 5)

The gaze safety module of claim 5, wherein the first value indicates delayed, and the resume delay indicates a value greater than zero.

### Claim 7 (depends on 5)

The gaze safety module of claim 5, wherein the first value indicates immediate, and the resume delay indicates a value equal zero.

### Claim 8

A method for controlling playback of a media player in an autonomous vehicle, the method comprising:
receiving, by a gaze area classifier, first sensor data from a sensor;
determining, by the gaze area classifier, a first gaze classification of a driver based, at least in part, on the first sensor data;
receiving, by a monitoring needs estimator, driving condition data;
determining, by the monitoring needs estimator, one or more gaze requirements;
pausing, by a display control, playback of a media player based, at least in part, on the first gaze classification and the one or more gaze requirements; and
determining, by the display control, a first value for a resume type variable based, at least in part, on the first gaze classification and the one or more gaze requirements.

### Claim 9 (depends on 8)

The method of claim 8, wherein the one or more gaze requirements comprises an on-road glance frequency, the first gaze classification is on-device, and the first value indicates immediate.

### Claim 10 (depends on 8)

The method of claim 8, wherein the one or more gaze requirements comprises an on-road glance time, the first gaze classification is on-device, and the first value indicates immediate.

### Claim 11 (depends on 8)

The method of claim 8, wherein the one or more gaze requirements comprises an away glance frequency, the first gaze classification is away, and the first value indicates delayed.

### Claim 12 (depends on 8)

The method of claim 8, further comprising:
receiving, by the gaze area classifier, second sensor data from the sensor; and
determining, by the gaze area classifier, a second gaze classification of the driver based, at least in part, on the second sensor data; and
determining, by the display control, a resume delay based, at least in part, on the first value; and
resuming, by the display control, playback of the media player based, at least in part, on the second gaze classification, the one or more gaze requirements, and the first value.

### Claim 13 (depends on 12)

The method of claim 12, wherein the first value indicates delayed, and the resume delay indicates a value greater than zero.

### Claim 14 (depends on 12)

The method of claim 12, wherein the first value indicates immediate, and the resume delay indicates a value equal zero.

### Claim 15

An autonomous vehicle comprising:
a sensor;
a media player; and
a gaze safety module comprising:
a gaze area classifier configured to:
receive first sensor data from the sensor; and
determine a first gaze classification of a driver based, at least in part, on the first sensor data;
a monitoring needs estimator configured to:
receive driving condition data; and
determine one or more gaze requirements;
a display control configured to:
pause playback of the media player based, at least in part, on the first gaze classification and the one or more gaze requirements; and
determine a first value for a resume type variable based, at least in part, on the first gaze classification and the one or more gaze requirements.

### Claim 16 (depends on 15)

The autonomous vehicle of claim 15, wherein the one or more gaze requirements comprises an on-road glance frequency, the first gaze classification is on-device, and the first value indicates immediate.

### Claim 17 (depends on 15)

The autonomous vehicle of claim 15, wherein the one or more gaze requirements comprises an on-road glance time, the first gaze classification is on-device, and the first value indicates immediate.

### Claim 18 (depends on 15)

The autonomous vehicle of claim 15, wherein the one or more gaze requirements comprises an away glance frequency, the first gaze classification is away, and the first value indicates delayed.

### Claim 19 (depends on 15)

The autonomous vehicle of claim 15, wherein:
the gaze area classifier is further configured to:
receive second sensor data from the sensor; and
determine a second gaze classification of the driver based, at least in part, on the second sensor data; and
the display control further configured to:
determine a resume delay based, at least in part, on the first value; and
resume playback of the media player based, at least in part, on the second gaze classification, the one or more gaze requirements, and the first value.

### Claim 20 (depends on 19)

The autonomous vehicle of claim 19, wherein the first value indicates delayed, and the resume delay indicates a value greater than zero.

### Claim 21 (depends on 19)

The autonomous vehicle of claim 19, wherein the first value indicates immediate, and the resume delay indicates a value equal zero.
