# US 2025/0148810 A1 · Systems and methods for performing operations in a vehicle using gaze detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0148810 A1
- Document ID: US20250148810A1
- Status: Published application
- Kind: A1
- Application number: 19/019,008
- Filed: 2025-01-13
- Published: 2025-05-08
- Earliest claimed: 2020-04-27
- Assignees: NVIDIA Corporation
- Applicants: NVIDIA Corporation
- Inventors: Jason Conrad Roche; Niranjan Avadhanam
- Web page: https://patentgrep.com/patent/US20250148810A1

## CPC

- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06N 3/02: Neural networks
- G06N 20/00: Machine learning
- B60K 2360/148: Instrument input by voice
- B60K 2360/149: Instrument input by detecting viewing direction not otherwise provided for
- B60K 2360/164: Infotainment
- B60K 2360/199: for avoiding maloperation
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

In various examples, systems and methods are disclosed herein for a vehicle command operation system that may use technology across multiple modalities to cause vehicular operations to be performed in response to determining a focal point based on a gaze of an occupant. The system may utilize sensors to receive first data indicative of an eye gaze of an occupant of the vehicle. The system may utilize sensors to receive second data indicative of other data from the occupant. The system may then calculate a gaze vector based on the data indicative of the eye gaze of the occupant. The system may determine a focal point based on the gaze vector. In response to determining the focal point, the system causes an operation to be performed in the vehicle based on the second data.

## Claims

### Claim 1

A method comprising:
computing, using sensor data collected by one or more sensors of a vehicle, one or more focal points corresponding to a gaze vector of an occupant of the vehicle;
determining the one or more focal points correspond to one or more historical focal points; and
performing one or more operations corresponding to the vehicle based at least on determining that the one or more focal points correspond to the one or more historical focal points.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining that the one or more focal points correspond to the one or more historical focal points is based at least on an operation count of one or more historical operations being performed in association with the one or more historical focal points.

### Claim 3 (depends on 2)

The method of claim 2, wherein determining that the one or more focal points correspond to the one or more historical focal points is based at least on the operation count exceeding a threshold value.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining that the one or more focal points correspond to the one or more historical focal points is based at least on evaluating one or more proximities of the one or more focal points to the one or more historical focal points.

### Claim 5 (depends on 1)

The method of claim 1, wherein based at least on determining that the one or more focal points correspond to the one or more historical focal points, the one or more operations include at least one operation associated with the one or more historical focal points.

### Claim 6 (depends on 1)

The method of claim 1, wherein based at least on determining that the one or more focal points correspond to the one or more historical focal points, the one or more operations include at least one operation assigned to the one or more historical focal points using a user interface associated with the vehicle.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining that the one or more focal points correspond to the one or more historical focal points is based at least on receiving a confirmatory selection of the one or more historical focal points from a user interface associate with the vehicle.

### Claim 8 (depends on 1)

The method of claim 1, wherein the one or more historical focal points correspond to a region within a spatial mapping that corresponds to an interior of the vehicle.

### Claim 9 (depends on 1)

The method of claim 1, wherein the one or more operations are further performed based at least on receiving, in association with the one or more focal points and using a user interface associated with the vehicle, one or more requests indicating the one or more operations.

### Claim 10

A system comprising:
one or more processors to perform operations including:
computing, using sensor data collected by one or more sensors of a vehicle, one or more focal points corresponding to a gaze vector of an occupant of the vehicle;
determining the one or more focal points correspond to one or more historical focal points; and
performing one or more operations corresponding to the vehicle based at least on determining that the one or more focal points correspond to the one or more historical focal points.

### Claim 11 (depends on 10)

The system of claim 10, wherein determining that the one or more focal points correspond to the one or more historical focal points is based at least on an operation count of one or more historical operations being performed in association with the one or more historical focal points.

### Claim 12 (depends on 10)

The system of claim 10, wherein determining that the one or more focal points correspond to the one or more historical focal points is based at least on evaluating one or more proximities of the one or more focal points to the one or more historical focal points.

### Claim 13 (depends on 10)

The system of claim 10, wherein based at least on determining that the one or more focal points correspond to the one or more historical focal points, the one or more operations include at least one operation associated with the one or more historical focal points.

### Claim 14 (depends on 10)

The system of claim 10, wherein based at least on determining that the one or more focal points correspond to the one or more historical focal points, the one or more operations include at least one operation assigned to the one or more historical focal points using a user interface associated with the vehicle.

### Claim 15 (depends on 10)

The system of claim 10, wherein determining that the one or more focal points correspond to the one or more historical focal points is based at least on receiving a confirmatory selection of the one or more historical focal points from a user interface associate with the vehicle.

### Claim 16

At least one processor comprising:
one or more circuits to perform one or more operations corresponding to a vehicle based at least on:
one or more focal points corresponding to a gaze vector of an occupant of the vehicle, the one or more focal points computed using sensor data collected by one or more sensors of the vehicle, and
a determination that the one or more focal points correspond to one or more historical focal points.

### Claim 17 (depends on 16)

The at least one processor of claim 16, wherein the determination is based at least on an operation count of one or more historical operations being performed in association with the one or more historical focal points.

### Claim 18 (depends on 16)

The at least one processor of claim 16, wherein the determination is based at least on evaluating one or more proximities of the one or more focal points to the one or more historical focal points.

### Claim 19 (depends on 16)

The at least one processor of claim 16, wherein based at least on the determination, the one or more operations include at least one operation associated with the one or more historical focal points.

### Claim 20 (depends on 16)

The at least one processor of claim 16, wherein based at least on the determination, the one or more operations include at least one operation assigned to the one or more historical focal points using a user interface associated with the vehicle.
