# US 2025/0145168 A1 · Driver abnormality sign detection device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0145168 A1
- Document ID: US20250145168A1
- Status: Published application
- Kind: A1
- Application number: 18/940,911
- Filed: 2024-11-08
- Published: 2025-05-08
- Earliest claimed: 2023-11-08
- Assignees: Mazda Motor Corporation
- Applicants: Mazda Motor Corporation
- Inventors: Junichiro KUWAHARA; Makoto SEKIGUCHI; Taro IWAMOTO
- Web page: https://patentgrep.com/patent/US20250145168A1

## CPC

- B60W 40/08: related to drivers or passengers
- B60W 50/10: Interpretation of driver requests or demands
- B60W 2040/0818: {Inactivity or incapacity of driver}
- B60W 2520/10: Longitudinal speed
- B60W 2540/18: Steering angle
- B60W 2540/225: Direction of gaze
- B60W 2555/20: Ambient conditions, e.g. wind or rain
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT

## Abstract

A driver abnormality sign detection device includes a control circuit configured to detect an abnormality sign of a driver based on visual line information and on information for calculating a visual line parameter influencing motion of a visual line of the driver. The control circuit acquires a predetermined reference feature amount representing the motion of the visual line, calculates the visual line parameter, calculates a predicted feature amount representing the motion of the visual line by correcting the reference feature amount with a correction value acquired based on the visual line parameter, calculates a visual line abnormality degree which represents an extent that a measured feature amount acquired based on the visual line information and representing the motion of the visual line diverges from the predicted feature amount, and detects, based on the visual line abnormality degree, presence or absence the abnormality sign of the driver.

## Claims

### Claim 1

A driver abnormality sign detection device detecting an abnormality sign of a driver driving a vehicle, the driver abnormality sign detection device comprising:
a control circuit configured to detect the abnormality sign of the driver based on visual line information acquired from a visual line detector and from a visual line parameter detector, wherein
the control circuit is configured to
acquire a predetermined reference feature amount representing motion of the visual line,
calculate the visual line parameter based on the information acquired from the visual line parameter detector, and determine a correction value for correcting the reference feature amount based on the visual line parameter,
calculate a predicted feature amount representing the motion of the visual line by correcting the reference feature amount with the correction value,
calculate a visual line abnormality degree which represents an extent that an actual feature amount based on the visual line information and representing the motion of the visual line differs from the predicted feature amount, and
detect, based on the visual line abnormality degree, absence or presence of the abnormality sign of the driver.

### Claim 2 (depends on 1)

The driver abnormality sign detection device according to claim 1, wherein
the feature amount representing the motion of the visual line is a saccade frequency and/or a saccade amplitude of the driver.

### Claim 3 (depends on 2)

The driver abnormality sign detection device according to claim 2, wherein
the feature amounts representing the motion of the visual line are the saccade frequency and the saccade amplitude of the driver, and
the control circuit is configured to
accumulate two-dimensional data, in which a difference between an actual saccade frequency and a predicted saccade frequency is set as a first variable and a difference between an actual saccade amplitude and a predicted saccade amplitude is set as a second variable, and
calculate the visual line abnormality degree based on a Mahalanobis distance between a newest data point of the two-dimensional data and a centroid of a set of the accumulated two-dimensional data.

### Claim 4 (depends on 3)

The driver abnormality sign detection device according to claim 3, wherein
the visual line parameter includes at least one of an operation amount of a steering wheel of the vehicle, a vehicle speed, a saliency distribution in a visual field of the driver, illuminance around the vehicle, and a direction of a face of the driver.

### Claim 5 (depends on 4)

The driver abnormality sign detection device according to claim 4, wherein, to determine the correction value, the control circuit is configured to:
input the operation of the steering wheel of the vehicle and the vehicle speed to a vehicle state influence model,
input the saliency distribution in a visual field of the driver and the illuminance around the vehicle to a traveling environment influence model, and
input the direction of a face of the driver to a head behavior influence model.

### Claim 6 (depends on 5)

The driver abnormality sign detection device according to claim 5, wherein:
the vehicle state influence model includes correction maps that define relationships between a standard deviation of the steering angle and an average vehicle speed and outputs a first correction value for each of the saccade frequency and the saccade amplitude;
the traveling environment influence model includes correction maps that define relationships between dispersion of the saliency and an average illuminance value of the traveling environment and outputs a second correction value for each of the saccade frequency and the saccade amplitude; and
the head behavior influence model includes a correction map the defines a standard deviation of the direction of the face of the driver in a predetermined time and outputs a third correction value for each of the saccade frequency and the saccade amplitude.

### Claim 7 (depends on 1)

The driver abnormality sign detection device according to claim 1, wherein
the feature amounts representing the motion of the visual line are a saccade frequency and a saccade amplitude of the driver, and
the control circuit is configured to
accumulate two-dimensional data, in which a difference between a measured saccade frequency and a predicted saccade frequency is set as a first variable and a difference between a measured saccade amplitude and a predicted saccade amplitude is set as a second variable, and
calculate the visual line abnormality degree based on a Mahalanobis distance between a newest data point of the two-dimensional data and a centroid of a set of the accumulated two-dimensional data.

### Claim 8 (depends on 1)

The driver abnormality sign detection device according to claim 1, wherein
the visual line parameter includes at least one of an operation amount of a steering wheel of the vehicle, a vehicle speed, a saliency distribution in a visual field of the driver, illuminance around the vehicle, and a direction of a face of the driver.

### Claim 9 (depends on 8)

The driver abnormality sign detection device according to claim 8, wherein, to calculate the correction value, the control circuit is configured to calculate at least two correction values for correcting the reference feature amount based on at least two of the visual line parameters.

### Claim 10

A driver abnormality sign detection device detecting an abnormality sign of a driver driving a vehicle, the driver abnormality sign detection device comprising:
a control circuit configured to detect the abnormality sign of the driver based on visual line information form a visual line detector that detects a visual line of the driver and visual line parameter information for calculating a visual line parameter including at least one of an operation amount of a steering wheel of the vehicle, a vehicle speed, a saliency distribution in a visual field of the driver, illuminance around the vehicle influencing motion of the visual line of the driver acquired by a visual line parameter information detector, wherein
the control circuit is configured to
acquire a reference saccade frequency and/or a reference saccade amplitude of an unimpaired driver,
calculate the visual line parameter based on the information acquired from the visual line parameter information detector, and determine a correction value for correcting the reference saccade frequency and/or the reference saccade amplitude based on the visual line parameter,
calculate a predicted saccade frequency and/or a predicted saccade amplitude representing the motion of the visual line by correcting the reference saccade frequency and/or the reference saccade amplitude with the correction value,
calculate a visual line abnormality degree which represents an extent that a measured saccade frequency and/or a measured saccade amplitude based on the visual line information and representing the motion of the visual line diverges from the predicted saccade frequency and/or the predicted saccade amplitude, and
detect, based on the visual line abnormality degree, absence or presence of the abnormality sign of the driver.

### Claim 11 (depends on 10)

The driver abnormality sign detection device according to claim 10, wherein
both the saccade frequency and the saccade amplitude are used, and
the control circuit is configured to
accumulate two-dimensional data, in which a first variable is a difference between the measured saccade frequency and the predicted saccade frequency is set as a first variable and a second variable is a difference between the measured saccade amplitude and the predicted saccade amplitude, and
calculate the visual line abnormality degree based on a Mahalanobis distance between a newest data point of the two-dimensional data and a centroid of a set of the accumulated two-dimensional data.

### Claim 12 (depends on 11)

The driver abnormality sign detection device according to claim 11, the control circuit is configured to calculate at least two correction values for correcting each of the saccade frequency and the saccade amplitude of the driver amount based on at least two of the visual line parameters.

### Claim 13

A non-transitory computer readable storage device having computer readable instructions that when executed by circuitry cause the circuitry to:
acquire a reference feature amount representing motion of the visual line,
calculate a visual line parameter based on visual line parameter information acquired from a visual line parameter detector,
determine a correction value for correcting the reference feature amount based on the visual line parameter,
calculate a predicted feature amount representing the motion of the visual line by correcting the reference feature amount with the correction value,
calculate a visual line abnormality degree which represents an extent that a measured feature amount based on the visual line information and representing the motion of the visual line diverges from the predicted feature amount, and
detect, based on the visual line abnormality degree, presence or absence of the abnormality sign of the driver.
