# US 2026/0073549 A1 · Artificial intelligence modeling techniques for vision-based occupancy determination

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073549 A1
- Document ID: US20260073549A1
- Status: Published application
- Kind: A1
- Application number: 19/384,859
- Filed: 2025-11-10
- Published: 2026-03-12
- Earliest claimed: 2022-09-09
- Assignees: Tesla, Inc.
- Applicants: Tesla, Inc.
- Inventors: Pengfei DUAN; Nishant DESAI; Philip LEE; Ashok ELLUSWAMY
- Web page: https://patentgrep.com/patent/US20260073549A1

## CPC

- G06T 7/62: of area, perimeter, diameter or volume
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06T 15/08: Volume rendering
- G06V 10/764: using classification, e.g. of video objects
- G06V 20/647: {by matching two-dimensional images to three-dimensional objects}
- B60W 60/001: {Planning or execution of driving tasks}
- B60W 2420/403: Image sensing, e.g. optical camera
- G06T 2207/20081: Training; Learning
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT

## Abstract

Disclosed herein are methods and systems for using artificial intelligence modeling techniques to train and execute an artificial intelligence model to analyze camera feed received from an ego to generate an occupancy data indicating whether different voxels within the ego's surroundings are occupied by an object having mass. A method comprises inputting, using a camera of an ego object, image data of a space around the ego object into an artificial intelligence model; predicting, by executing the artificial intelligence model, an occupancy attribute of a plurality of voxels; and generating a dataset based on the plurality of voxels and their corresponding occupancy attribute.

## Claims

### Claim 1

A method, comprising:
obtaining sensor data from a camera representing a space around an ego object during operation of the ego object;
inputting, by one or more processors, the sensor data into an artificial intelligence model to cause the artificial intelligence model to generate an output representing three-dimensional (3D) occupancy data comprising a first voxel having a first size and a second voxel having a second size, the first voxel representing a first area in the space within a first threshold distance from the ego object and the second voxel representing a second area in the space that is at least in part outside of the first threshold distance;
predicting, by the one or more processors, an occupancy attribute of 3D occupancy data based on the first voxel or the second voxel; and
generating, by the one or more processors, a dataset based on the 3D occupancy data and the occupancy attribute.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
generating, by the one or more processors, a representation of an environment based on the 3D occupancy data, the representation of the environment comprising a graphical indicator of the occupancy attribute of the 3D occupancy data.

### Claim 3 (depends on 2)

The method of claim 2, where generating the output comprises:
generating, by the one or more processors, the representation of the environment such that the representation of the environment indicates a location of a detected object indicated by the occupancy attribute in the environment.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
determining, by the one or more processors, to display the output at a display device of the ego object; and
causing, by the one or more processors, the output to be displayed at the display device of the ego object in response to determining to display the output.

### Claim 5 (depends on 1)

The method of claim 1, wherein generating the dataset comprises:
generating, by the one or more processors, the dataset to comprise a queryable dataset configured to transmit the occupancy attribute of the 3D occupancy data to an autonomous driving protocol executed by a computing device of the ego object; and
causing, by the one or more processors, the autonomous driving protocol to be executed based on the dataset.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
executing, by the one or more processors, one or more operations to featurize the sensor data representing the space around the ego object; and
inputting, by the one or more processors, the sensor data into the artificial intelligence model to cause the artificial intelligence model to generate the output representing the 3D occupancy data.

### Claim 7 (depends on 1)

The method of claim 1, wherein the sensor data comprises two-dimensional (2D) visual data generated by a plurality of cameras associated with the ego object, the method further comprising:
temporally aligning, by the one or more processors, the 2D visual data; and
determining to input, by the one or more processors, the sensor data into the artificial intelligence model to cause the artificial intelligence model to generate an output representing the 3D occupancy data.

### Claim 8

A system, comprising:
a camera; and
one or more processors configured to:
obtain sensor data from a camera representing a space around an ego object during operation of the ego object;
input the sensor data into an artificial intelligence model to cause the artificial intelligence model to generate an output representing three-dimensional (3D) occupancy data comprising a first voxel having a first size and a second voxel having a second size, the first voxel representing a first area in the space within a first threshold distance from the ego object and the second voxel representing a second area in the space that is at least in part outside of the first threshold distance;
predict an occupancy attribute of 3D occupancy data based on the first voxel or the second voxel; and
generate a dataset based on the 3D occupancy data and the occupancy attribute.

### Claim 9 (depends on 8)

The system of claim 8, wherein the one or more processors are further configured to:
generate a representation of an environment based on the 3D occupancy data, the representation of the environment comprising a graphical indicator of the occupancy attribute of the 3D occupancy data.

### Claim 10 (depends on 9)

The system of claim 9, wherein the one or more processors are configured to:
generate the representation of the environment such that the representation of the environment indicates a location of a detected object indicated by the occupancy attribute in the environment.

### Claim 11 (depends on 8)

The system of claim 8, wherein the one or more processors are further configured to:
determine to display the output at a display device of the ego object; and
cause the output to be displayed at the display device of the ego object in response to determining to display the output.

### Claim 12 (depends on 8)

The system of claim 8, wherein the one or more processors configured to generate the dataset are configured to:
generate the dataset to comprise a queryable dataset configured to transmit the occupancy attribute of the 3D occupancy data to an autonomous driving protocol executed by a computing device of the ego object; and
cause the autonomous driving protocol to be executed based on the dataset.

### Claim 13 (depends on 8)

The system of claim 8, wherein the one or more processors are further configured to:
execute one or more operations to featurize the sensor data representing the space around the ego object; and
input the sensor data into the artificial intelligence model to cause the artificial intelligence model to generate the output representing the 3D occupancy data.

### Claim 14 (depends on 8)

The system of claim 8, wherein the sensor data comprises two-dimensional (2D) visual data generated by a plurality of cameras associated with the ego object,
wherein the one or more processors are further configured to:
temporally align the 2D visual data; and
determine to input the sensor data into the artificial intelligence model to cause the artificial intelligence model to generate an output representing the 3D occupancy data.

### Claim 15

One or more non-transitory computer-readable mediums having instructions stored thereon that, when executed by one or more processors, cause the one or more processors to execute operations comprising:
obtaining sensor data from a camera representing a space around an ego object during operation of the ego object;
inputting the sensor data into an artificial intelligence model to cause the artificial intelligence model to generate an output representing three-dimensional (3D) occupancy data comprising a first voxel having a first size and a second voxel having a second size, the first voxel representing a first area in the space within a first threshold distance from the ego object and the second voxel representing a second area in the space that is at least in part outside of the first threshold distance;
predicting an occupancy attribute of 3D occupancy data based on the first voxel or the second voxel; and
generating a dataset based on the 3D occupancy data and the occupancy attribute.

### Claim 16 (depends on 15)

The one or more non-transitory computer-readable mediums of claim 15, wherein the instructions further cause the one or more processors to:
generate a representation of an environment based on the 3D occupancy data, the representation of the environment comprising a graphical indicator of the occupancy attribute of the 3D occupancy data.

### Claim 17 (depends on 16)

The one or more non-transitory computer-readable mediums of claim 16, where the instructions that cause the one or more processors to generate the representation of the environment cause the one or more processors to:
generate the representation of the environment such that the representation of the environment indicates a location of a detected object indicated by the occupancy attribute in the environment.

### Claim 18 (depends on 15)

The one or more non-transitory computer-readable mediums of claim 15, wherein the instructions further cause the one or more processors to:
determine to display the output at a display device of the ego object; and
cause the output to be displayed at the display device of the ego object in response to determining to display the output.

### Claim 19 (depends on 15)

The one or more non-transitory computer-readable mediums of claim 15, wherein the instructions that cause the one or more processors to generate the dataset cause the one or more processors to:
generate the dataset to comprise a queryable dataset configured to transmit the occupancy attribute of the 3D occupancy data to an autonomous driving protocol executed by a computing device of the ego object; and
cause the autonomous driving protocol to be executed based on the dataset.

### Claim 20 (depends on 15)

The one or more non-transitory computer-readable mediums of claim 15, wherein the instructions further cause the one or more processors to:
execute one or more operations to featurize the sensor data representing the space around the ego object; and
input the sensor data into the artificial intelligence model to cause the artificial intelligence model to generate the output representing the 3D occupancy data.
