# US 2026/0073702 A1 · Systems and methods for predicting occupancy in a voxel representation of an environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073702 A1
- Document ID: US20260073702A1
- Status: Published application
- Kind: A1
- Application number: 18/913,900
- Filed: 2024-10-11
- Published: 2026-03-12
- Earliest claimed: 2024-09-10
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Yunxiao SHI; Hong CAI; Amin ANSARI; Fatih Murat PORIKLI; Avdhut JOSHI; Ahmed Kamel SADEK
- Web page: https://patentgrep.com/patent/US20260073702A1

## CPC

- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06T 7/55: from multiple images
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/82: using neural networks
- G06T 2207/20081: Training; Learning
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Imaging systems and techniques are described. In some examples, an imaging system extracts a plurality of features from the plurality of images of an environment. The plurality of images include different perspectives on the environment. The imaging system processes the plurality of features to generate a voxel-based representation of the environment. The voxel-based representation includes a plurality of voxels. The imaging system analyzes the plurality of images and the voxel-based representation to classify a first subset of the plurality of voxels into a first object category and to classify a second subset of the plurality of voxels into a second object category.

## Claims

### Claim 1

An apparatus to process image data, the apparatus comprising:
one or more memories configured to store a plurality of images; and
one or more processors coupled to the one or more memories and configured to:
extract a plurality of features from the plurality of images of an environment, wherein the plurality of images include different perspectives on the environment;
process the plurality of features to generate a voxel-based representation of the environment, wherein the voxel-based representation includes a plurality of voxels; and
analyze the plurality of images and the voxel-based representation to classify a first subset of the plurality of voxels into a first object category and to classify a second subset of the plurality of voxels into a second object category.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein, to extract the plurality of features from the plurality of images, the one or more processors are configured to process the plurality of images using a trained machine learning model.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the one or more processors are configured to:
further train the trained machine learning model based on feedback associated with a classification of at least one of the plurality of voxels.

### Claim 4 (depends on 2)

The apparatus of claim 2, wherein the one or more processors are configured to:
analyze the plurality of images and the voxel-based representation to generate a two-dimensional depth map of the environment; and
further train the trained machine learning model based on feedback associated with the two-dimensional depth map.

### Claim 5 (depends on 2)

The apparatus of claim 2, wherein the one or more processors are configured to:
analyze the plurality of images and the voxel-based representation to generate a two-dimensional semantic map of the environment; and
further train the trained machine learning model based on feedback associated with the two-dimensional semantic map.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein, to generate the voxel-based representation of the environment, the one or more processors are configured to process the plurality of features using a trained machine learning model.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the one or more processors are configured to:
further train the trained machine learning model based on feedback associated with a classification of at least one of the plurality of voxels.

### Claim 8 (depends on 6)

The apparatus of claim 6, wherein the one or more processors are configured to:
analyze the plurality of images and the voxel-based representation to generate a two-dimensional depth map of the environment; and
further train the trained machine learning model based on feedback associated with the two-dimensional depth map.

### Claim 9 (depends on 6)

The apparatus of claim 6, wherein the one or more processors are configured to:
analyze the plurality of images and the voxel-based representation to generate a two-dimensional semantic map of the environment; and
further train the trained machine learning model based on feedback associated with the two-dimensional semantic map.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein, to generate the voxel-based representation of the environment, the one or more processors are configured to process the plurality of features using a plurality of layers of a trained machine learning model, wherein the plurality of layers lack cross-attention.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein, to generate the voxel-based representation of the environment, the one or more processors are configured to perform feature averaging using the plurality of features based on the different perspectives.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the feature averaging is based on bilinear interpolation.

### Claim 13 (depends on 1)

The apparatus of claim 1, wherein, to classify the first subset into the first object category and to classify the second subset into the second object category, the one or more processors are configured to analyze the plurality of images and the voxel-based representation using a trained machine learning model.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the one or more processors are configured to:
further train the trained machine learning model based on feedback associated with a classification of at least one of the plurality of voxels.

### Claim 15 (depends on 13)

The apparatus of claim 13, wherein the one or more processors are configured to:
analyze the plurality of images and the voxel-based representation to generate a two-dimensional depth map of the environment; and
further train the trained machine learning model based on feedback associated with the two-dimensional depth map.

### Claim 16 (depends on 13)

The apparatus of claim 13, wherein the one or more processors are configured to:
analyze the plurality of images and the voxel-based representation to generate a two-dimensional semantic map of the environment; and
further train the trained machine learning model based on feedback associated with the two-dimensional semantic map.

### Claim 17 (depends on 1)

The apparatus of claim 1, further comprising one or more cameras configured to capture the plurality of images.

### Claim 18 (depends on 1)

The apparatus of claim 1, wherein the first object category corresponds to occupied voxels, and wherein the second object category corresponds to free voxels.

### Claim 19 (depends on 1)

The apparatus of claim 1, wherein the first object category corresponds to a first material type, and wherein the second object category corresponds to a second material type.

### Claim 20

A method to process image data, the method comprising:
extracting a plurality of features from a plurality of images of an environment, wherein the plurality of images include different perspectives on the environment;
processing the plurality of features to generate a voxel-based representation of the environment, wherein the voxel-based representation includes a plurality of voxels; and
analyzing the plurality of images and the voxel-based representation to classify a first subset of the plurality of voxels into a first object category and to classify a second subset of the plurality of voxels into a second object category.
