US 11,538,259 B2Granted

Toward real-time estimation of driver situation awareness: an eye tracking approach based on moving objects of interest

AssigneeHonda Motor Co., Ltd.

InventorsSujitha Catherine Martin, Teruhisa Misu, Hyungil Kim, Ashish Tawari, Joseph L. Gabbard

Life of this patent

Estimating the term…

Loading patent…

Abstract

The present disclosure provides a method and system to operationalize driver eye movement data analysis based on moving objects of interest. Correlation and/or regression analyses between indirect (e.g., eye-tracking) and/or direct measures of driver awareness may identify variables that feature spatial and/or temporal aspects of driver eye glance behavior relative to objects of interest. The proposed systems and methods may be further combined with computer-vision techniques such as object recognition to (e.g., fully) automate eye movement data processing as well as machine learning approaches to improve the accuracy of driver awareness estimation.

Claims25

Dependent claims

A non-transitory computer-readable storage medium including instructions, wherein the instructions are configured to be executed by one or more processors of an electronic device, and wherein the instructions are for:

detecting, using one or more sensors, one or more first characteristics associated with a gaze of a person with respect to an object during a period of time;
detecting, using the one or more sensors, one or more second characteristics that are different from the one or more first characteristics, and that are associated with the gaze of the person with respect to the object at a first time after the period of time;
determining, using a predictive model, a first score corresponding to a likelihood that the person is aware of the object based on the one or more first characteristics and the one or more second characteristics;
determining, using the predictive model, a second score corresponding to a likelihood that the person has confidence in their awareness of the object based on the one or more first characteristics and the one or more second characteristics;
and
selectively performing an operation based on the first score or the second score.

3 more elements

A method comprising:

at an electronic device with one or more processors and memory:
detecting, using one or more sensors, one or more first characteristics associated with a gaze of a person with respect to an object during a period of time;
detecting, using the one or more sensors, one or more second characteristics that are different from the one or more first characteristics, and that are associated with the gaze of the person with respect to the object at a first time after the period of time;
determining, using a predictive model, a first score corresponding to a likelihood that the person is aware of the object based on the one or more first characteristics and the one or more second characteristics;
determining, using the predictive model, a second score corresponding to a likelihood that the person has confidence in their awareness of the object based on the one or more first characteristics and the one or more second characteristics;
and
selectively performing an operation based on the first score or the second score.

4 more elements

An electronic device comprising:

one or more processors;
and
memory storing instructions, which when executed by the one or more processors, cause the electronic device to perform a method comprising:
detecting, using one or more sensors, one or more first characteristics associated with a gaze of a person with respect to an object during a period of time;
detecting, using the one or more sensors, one or more second characteristics that are different from the one or more first characteristics, and that are associated with the gaze of the person with respect to the object at a first time after the period of time;
determining, using a predictive model, a first score corresponding to a likelihood that the person is aware of the object based on the one or more first characteristics and the one or more second characteristics;
determining, using the predictive model, a second score corresponding to a likelihood that the person has confidence in their awareness of the object based on the one or more first characteristics and the one or more second characteristics;
and
selectively performing an operation based on the first score or the second score.

6 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/950,820Filed 17 Nov 2020 · us provisional application
Priority: 6 Feb 2020
Published: US 2021/0248399 A112 Aug 2021
Granted: 27 Dec 2022
Term ends: Not estimatedThe source records don’t support an estimate.

Classification20 codes

G06F 3/013
Arrangements for interaction with the human body, e.g. for user immersion in virtual reality: eye tracking input arrangements
B60W 30/09
Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences: taking automatic action…
B60W 40/08
Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a…:…
B60W 60/001
Drive control systems specially adapted for autonomous road vehicles: planning or execution of driving tasks