# US 2026/0087825 A1 · Semantic guided efficient perspective view to bev projection and sampling

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087825 A1
- Document ID: US20260087825A1
- Status: Published application
- Kind: A1
- Application number: 18/893,249
- Filed: 2024-09-23
- Published: 2026-03-26
- Earliest claimed: 2024-09-23
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Meysam Sadeghigooghari; Ahmed Kamel Sadek; Tae Hoon Kim
- Web page: https://patentgrep.com/patent/US20260087825A1

## CPC

- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/26: Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V 10/806: {of extracted features}
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A device for processing frame data may be configured to identify one or more semantic characteristics for the frame data, wherein the frame data comprises a plurality of frames, each frame of the plurality of frames being acquired for a same scene and by a different frame source of a plurality of frame sources; extract features from each respective frame of the plurality of frames; determine a non-uniform sampling pattern of the plurality of frames based on the one or more semantic characteristics; and project, using the non-uniform sampling pattern, a portion of the extracted features into a bird's-eye-view (BEV) space having a grid structure to generate a fused set of BEV features.

## Claims

### Claim 1

An apparatus for processing frame data, the apparatus comprising:
a memory for storing the frame data; and
processing circuitry in communication with the memory, wherein the processing circuitry is configured to:
identify one or more semantic characteristics for the frame data, wherein the frame data comprises a plurality of frames, each frame of the plurality of frames being acquired for a same scene and by a different frame source of a plurality of frame sources;
extract features from each respective frame of the plurality of frames;
determine a non-uniform sampling pattern of the plurality of frames based on the one or more semantic characteristics; and
project, using the non-uniform sampling pattern, a portion of the extracted features into a bird's-eye-view (BEV) space having a grid structure to generate a fused set of BEV features.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein to identify the one or more semantic characteristics for the frame data, the processing circuitry is configured to perform object detection on the frame data to identify an object belonging to a predetermined class of objects.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein to identify the one or more semantic characteristics for the frame data, the processing circuitry is configured to retrieve the one or more semantic characteristics from a database based on a location of where the frame data was acquired.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein to identify the one or more semantic characteristics for the frame data, the processing circuitry is configured to receive the one or more semantic characteristics from an advanced driver assistance system (ADAS) or an autonomous driving (AD) system.

### Claim 5 (depends on 1)

The apparatus of claim 1, the processing circuitry is further configured to uniformly project another portion of the extracted features into the BEV space having the grid structure.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the frame data comprises image data, the plurality of frames comprises a plurality of images, and the plurality of frame sources comprises a plurality of cameras.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the frame data comprises radar data, the plurality of frames comprises a plurality of radar frames, and the plurality of frame sources comprises a plurality of radar devices.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the frame data comprises LiDAR data, the plurality of frames comprises a plurality of LiDAR frames, and the plurality of frame sources comprises a plurality of LiDAR devices.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the processing is circuitry is further configured to:
apply, to the fused set of BEV features, an object detection decoder to generate a set of bounding boxes that indicate a location of one or more objects within the BEV space.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the processing is circuitry is further configured to:
apply, to the fused set of BEV features, a segmentation decoder to identify types of objects in the fused set of BEV features.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the processing circuitry and the memory are part of an advanced driver assistance system (ADAS) or an autonomous driving (AD) system.

### Claim 12

A method for processing frame data, the method comprising:
identifying one or more semantic characteristics for the frame data, wherein the frame data comprises a plurality of frames, each frame of the plurality of frames being acquired for a same scene and by a different frame source of a plurality of frame sources;
extracting features from each respective frame of the plurality of frames;
determining a non-uniform sampling pattern based on the one or more semantic characteristics; and
projecting, using the non-uniform sampling pattern, a portion of the extracted features into a bird's-eye-view (BEV) space having a grid structure to generate a fused set of BEV features.

### Claim 13 (depends on 12)

The method of claim 12, wherein identifying the one or more semantic characteristics for the frame data, comprises performing object detection on the frame data to identify an object belonging to a predetermined class of objects.

### Claim 14 (depends on 12)

The method of claim 12, wherein identifying the one or more semantic characteristics for the frame data, comprises retrieving the one or more semantic characteristics from a database based on a location of where the frame data was acquired.

### Claim 15 (depends on 12)

The method of claim 12, wherein identifying the one or more semantic characteristics for the frame data, comprises receiving the one or more semantic characteristics from an advanced driver assistance system (ADAS) or an autonomous driving (AD) system.

### Claim 16 (depends on 12)

The method of claim 12, further comprising:
uniformly projecting another portion of the extracted features into the BEV space having the grid structure.

### Claim 17 (depends on 12)

The method of claim 12, wherein the frame data comprises image data, the plurality of frames comprises a plurality of images, and the plurality of frame sources comprises a plurality of cameras.

### Claim 18 (depends on 12)

The method of claim 12, wherein the frame data comprises LiDAR data, the plurality of frames comprises a plurality of LiDAR frames, and the plurality of frame sources comprises a plurality of LiDAR devices.

### Claim 19 (depends on 12)

The method of claim 12, further comprising:
applying, to the fused set of BEV features, an object detection decoder to generate a set of bounding boxes that indicate a location of one or more objects within the BEV space.

### Claim 20 (depends on 12)

The method of claim 12, further comprising:
applying, to the fused set of BEV features, a segmentation decoder to identify types of objects in the fused set of BEV features.
