Back to results
US 2022/0026987 A1Published application
Gaze detection using one or more neural networks
AssigneeNVIDIA Corporation
InventorsFeng Hu, Niranjan Avadhanam, Yuzhuo Ren, Sujay Yadawadkar, Sakthivel Sivaraman, Hairong Jiang, Siyue Wu
Life of this patent
Estimating the term…
Abstract
Apparatuses, systems, and techniques are described to determine locations of objects using images including digital representations of those objects. In at least one embodiment, a gaze of one or more occupants of a vehicle is determined independently of a location of one or more sensors used to detect those occupants.
Claims20
A method, comprising:
- detecting an instruction spoken by an occupant of a vehicle;
- determining a gaze direction of the occupant;
- determining, based at least in part upon the gaze direction, one or more components of the vehicle corresponding to the instruction;
- and
- causing the instruction to be performed with respect to the one or more components.
2 more elements
A system, comprising:
- at least one processor;
- and
- memory including instructions that, when executed by the at least one processor, cause the system to:
- detect an instruction spoken by an occupant of a vehicle;
- determine a gaze direction of the occupant;
- determine, based at least in part upon the gaze direction, one or more components of the vehicle corresponding to the instruction;
- and
- cause the instruction to be performed with respect to the one or more components.
5 more elements
A vehicle control system comprising:
- one or more cameras to capture image information for one or more occupants of a vehicle;
- one or more microphones to capture speech uttered by the one or more occupants;
- and
- a control system configured to:
- detect an instruction present in the captured speech;
- determine a gaze direction of the one or more occupants based at least in part upon the captured image information;
- determine, based at least in part upon the gaze direction, one or more components of the vehicle corresponding to the instruction;
- and
- cause the instruction to be performed with respect to the one or more components.
6 more elements
Dependencies are inferred from the claim text.