US 11,634,145 B2 · Systems and methods for detecting and dynamically mitigating driver fatigue

Abstract

This technology relates to dynamically detecting, managing and mitigating driver fatigue in autonomous systems. For instance, interactions of a driver in a vehicle may be monitored to determine a distance or time when primary tasks associated with operation of the vehicle or secondary tasks issued by the vehicle computing were last performed. If primary tasks or secondary tasks are not performed within given distance thresholds or time limits, then one or more secondary tasks are initiated by the computing device of the vehicle. In another instance, potential driver fatigue, driver distraction or overreliance on an automated driving system is detected based on gaze direction or pattern of a driver. For example, a detected gaze direction or pattern may be compared to an expected gaze direction or pattern given the surrounding environment in a vicinity of the vehicle.

Claims24

Dependent claims

A method for managing driver inattention, comprising:

acquiring, by one or more processors, images of one or both of a driver's eyes to determine an actual gaze pattern of the driver of a vehicle;
determining, by the one or more processors, an expected gaze pattern of the driver based on a planned route of the vehicle;
comparing, by the one or more processors, the actual gaze pattern to the expected gaze pattern;
determining, by the one or more processors based on the comparison, whether the driver's visual scanning of an external environment of the vehicle deviates from the expected gaze pattern;
determining, by the one or more processors based on deviation of the driver's visual scanning of the external environment from the expected gaze pattern, a fatigue state of the driver;
and
in response to the determined fatigue state of the driver, taking corrective action including initiating, by the one or more processors, an interactive cognitive task with the driver.

4 more elements

A vehicle comprising:

a driving system including a steering subsystem, an acceleration subsystem and a deceleration subsystem to control driving of the vehicle;
a perception system including one or more sensors configured to detect objects in an environment external to die vehicle;
a positioning system configured to determine a current position of the vehicle;
and
a control system including one or more processors, the control system operatively coupled to the driving system, the perception system and the positioning system, the control system being configured to:
acquire, from the perception system, images of one or both of a driver's eyes to determine an actual gaze pattern of the driver;
determine an expected gaze pattern of the driver based on a planned route of the vehicle;
compare the actual gaze pattern to the expected gaze pattern;
determine, based on the comparison, whether the driver's visual scanning of the external environment deviates from the expected gaze pattern;
determine, based on deviation of the driver's visual scanning of the external environment from the expected gaze pattern, a fatigue state of the driver;
and
in response to the determined fatigue state of the driver, take corrective action including initiating an interactive cognitive task with the driver.

9 more elements

Dependencies are inferred from the claim text.

Systems and methods for detecting and dynamically mitigating driver fatigue

Life of this patent

Systems and methods for detecting and dynamically mitigating driver fatigue

Life of this patent

Abstract

Claims24