Systems and methods for determining a viewing direction of a user
AssigneeToyota Research Institute, Inc.
InventorsHiroshi Yasuda, Alexander Russell Green
Life of this patent
Estimating the term…
Abstract
Vehicles and systems and methods for determining a viewing direction of a user are disclosed. In one embodiment, a system for detecting a viewing direction of a user includes a marker arranged at a fixed location, and an optical assembly. The optical assembly includes a first optical sensor arranged to view the marker, and a second optical sensor arranged to view the user. The first optical sensor detects the marker for determining a spatial location of the optical assembly with respect to the marker, and the second optical sensor detects an eye of the user for determining an eye angle of the user.
Claims16
A system for detecting a viewing direction of a user, comprising:
- an infrared (IR) reflective film configured to be attached to a surface;
- a device that projects a marker in IR light at a fixed location on the IR reflective film;
- an optical assembly, comprising:
- a first optical sensor arranged to view the marker;
- and
- a second optical sensor arranged to view the user;
- a processor;
- and
- a non-transitory computer-readable medium storing computer-readable instructions, that, when executed by the processor, cause the processor to:
- receive first data from the first optical sensor, wherein the first data includes a representation of the marker;
- receive second data from the second optical sensor, wherein the second data includes a representation of an eye of the user;
- determine a spatial location of the optical assembly with respect to the marker from the first data;
- determine the eye angle of the eye of the user from the second data;
- and determine the viewing direction of the user from the spatial location of the optical assembly and the eye angle of the eye of the user.
A system for detecting a viewing direction of a user within a vehicle, the system comprising:
- an infrared (IR) reflective film configured to be attached to a windshield of the vehicle;
- a device that projects a marker in IR light at a fixed location on the IR reflective film, wherein the marker is invisible to the user;
- an optical assembly configured to be arranged over the eyes of the user, the optical assembly comprising a first optical sensor arranged to view the marker and a second optical sensor arranged to view the user;
- a processor;
- and
- a non-transitory computer-readable medium storing computer-readable instructions, that, when executed by the processor, cause the processor to:
- receive first data from the first optical sensor, wherein the first data includes a representation of the marker;
- receive second data from the second optical sensor, wherein the second data includes a representation of an eye of the user;
- determine a spatial location of the optical assembly with respect to the marker from the first data;
- determine an eye angle of the eye of the user from the second data;
- and
- determine a viewing direction of the user from the spatial location of the optical assembly and the eye angle of the eye of the user.
A vehicle comprising:
- a windshield;
- an infrared (IR) reflective film attached to the windshield;
- a device that projects a marker in IR light at a fixed location on the IR reflective film such that the marker is viewable on the windshield;
- an optical assembly configured to be arranged on a head of a user, the optical assembly comprising:
- a first optical sensor arranged to view the marker;
- and
- a second optical sensor arranged to view an eye of the user;
- a processor;
- and
- a non-transitory computer-readable medium storing computer-readable instructions, that, when executed by the processor, cause the processor to:
- receive first data from the first optical sensor, wherein the first data includes a representation of the marker;
- receive second data from the second optical sensor, wherein the second data includes a representation of the eye of the user;
- determine a spatial location of the optical assembly with respect to the marker from the first data;
- determine an eye angle of the eye of the user from the second data;
- and
- determine a viewing direction of the user from the spatial location of the optical assembly and the eye angle of the eye of the user.
Dependencies are inferred from the claim text.