# US 2026/0098740 A1 · Modeling techniques for vision-based path determination

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0098740 A1
- Document ID: US20260098740A1
- Status: Published application
- Kind: A1
- Application number: 19/113,899
- Filed: 2023-09-29
- Published: 2026-04-09
- Earliest claimed: 2022-09-30
- Assignees: Tesla, Inc.
- Applicants: Tesla, Inc.
- Inventors: Shayan MAHDAVI; Pengfei Phil DUAN; Yekeun JEONG; Sascha HERRMANN; Jack HAN; Jonathan MARR
- Web page: https://patentgrep.com/patent/US20260098740A1

## CPC

- G01C 21/3602: {Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera}
- G01S 17/931: of land vehicles
- G01C 21/30: Map- or contour-matching
- G01C 21/3407: {specially adapted for specific applications}
- G01S 17/86: Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
- G01S 17/89: for mapping or imaging
- G06T 7/251: {involving models}
- G06T 7/75: {involving models}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30241: Trajectory
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Disclosed herein are methods and systems for using artificial intelligence modeling techniques to generate a path for an ego. In an embodiment, a method comprises retrieving image data of a space around an ego, the image data captured by a camera of the ego; predicting by executing an artificial intelligence model, an occupancy attribute of a plurality of voxels corresponding to the space around the ego; generating a 3D model corresponding to the space around the ego and each voxel's occupancy attribute; upon receiving a destination, localizing, by the processor, the ego by identifying a current location of the ego using a key image feature within the image data corresponding to the 3D model without receiving a location of the ego from a location tracking sensor; and generating a path for the ego to travel from the current location to the destination.

## Claims

### Claim 1

A method comprising:
retrieving, by a processor, image data of a space around an ego, the image data captured by a camera of the ego;
predicting, by the processor, by executing an artificial intelligence model, an occupancy attribute of a plurality of voxels corresponding to the space around the ego;
generating, by the processor, a 3D model corresponding to the space around the ego and each voxel's occupancy attribute;
upon receiving a destination, localizing, by the processor, the ego by identifying a current location of the ego using a key image feature within the image data corresponding to the 3D model without receiving a location of the ego from a location tracking sensor; and
generating, by the processor, a path for the ego to travel from the current location to the destination.

### Claim 2 (depends on 1)

The method of claim 1, further comprising periodically localizing, by the processor, the ego during the path.

### Claim 3 (depends on 1)

The method of claim 1, wherein localizing the ego comprises tracking the key image feature in successive image data.

### Claim 4 (depends on 1)

The method of claim 1, wherein the key image point corresponds to a unique point within the image data.

### Claim 5 (depends on 1)

The method of claim 1, wherein generating the path comprises generating at least one of a trajectory, yaw rate, forward velocity, or a lateral velocity for the ego.

### Claim 6 (depends on 1)

The method of claim 1, wherein the path is generated using an iterative linear quadratic regulator (ILQR) protocol.

### Claim 7 (depends on 1)

The method of claim 1, wherein the 3D model further corresponds to a surface attribute of at least one object within the space around the ego.

### Claim 8

A computer system comprising:
a non-transitory computer-readable medium having a set of instructions that when executed cause a processor to:
retrieve image data of a space around an ego, the image data captured by a camera of the ego;
predict by executing an artificial intelligence model, an occupancy attribute of a plurality of voxels corresponding to the space around the ego;
generate a 3D model corresponding to the space around the ego and each voxel's occupancy attribute;
upon receiving a destination, localize the ego by identifying a current location of the ego using a key image feature within the image data corresponding to the 3D model without receiving a location of the ego from a location tracking sensor; and
generate a path for the ego to travel from the current location to the destination.

### Claim 9 (depends on 8)

The computer system of claim 8, wherein the set of instructions further cause the processor to periodically localize the ego during the path.

### Claim 10 (depends on 8)

The computer system of claim 8, wherein localizing the ego comprises tracking the key image feature in successive image data.

### Claim 11 (depends on 8)

The computer system of claim 8, wherein the key image point corresponds to a unique point within the image data.

### Claim 12 (depends on 8)

The computer system of claim 8, wherein generating the path comprises generating at least one of a trajectory, yaw rate, forward velocity, or a lateral velocity for the ego.

### Claim 13 (depends on 8)

The computer system of claim 8, wherein the path is generated using an iterative linear quadratic regulator (ILQR) protocol.

### Claim 14 (depends on 8)

The computer system of claim 8, wherein the 3D model further corresponds to a surface attribute of at least one object within the space around the ego.

### Claim 15

An ego comprising:
a processor configured to:
retrieve image data of a space around the ego, the image data captured by a camera of the ego;
predict by executing an artificial intelligence model, an occupancy attribute of a plurality of voxels corresponding to the space around the ego;
generate a 3D model corresponding to the space around the ego and each voxel's occupancy attribute;
upon receiving a destination, localize the ego by identifying a current location of the ego using a key image feature within the image data corresponding to the 3D model without receiving a location of the ego from a location tracking sensor; and
generate a path for the ego to travel from the current location to the destination.

### Claim 16 (depends on 15)

The ego of claim 15, wherein the processor is further configured to periodically localize the ego during the path.

### Claim 17 (depends on 15)

The ego of claim 15, wherein localizing the ego comprises tracking the key image feature in successive image data.

### Claim 18 (depends on 15)

The ego of claim 15, wherein the key image point corresponds to a unique point within the image data.

### Claim 19 (depends on 15)

The ego of claim 15, wherein generating the path comprises generating at least one of a trajectory, yaw rate, forward velocity, or a lateral velocity for the ego.

### Claim 20 (depends on 15)

The ego of claim 15, wherein the path is generated using an iterative linear quadratic regulator (ILQR) protocol.
