# US 2024/0257384 A1 · Training Birds-Eye-View (BEV) Object Detection Models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0257384 A1
- Document ID: US20240257384A1
- Status: Published application
- Kind: A1
- Application number: 18/424,785
- Filed: 2024-01-27
- Published: 2024-08-01
- Earliest claimed: 2023-01-27
- Assignees: Aptiv Technologies AG
- Applicants: Aptiv Technologies AG
- Inventors: Moritz Luszek; Simon Roesler
- Web page: https://patentgrep.com/patent/US20240257384A1

## CPC

- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06F 18/2415: based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
- G06T 7/62: of area, perimeter, diameter or volume
- G06V 10/143: Sensing or illuminating at different wavelengths
- G06V 10/764: using classification, e.g. of video objects
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V 2201/07: Target detection
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A computer-implemented method for training a birds-eye-view (BEV) object detection model includes inputting a training sample into the model. The training sample includes a BEV image with multiple pixels, and multiple target confidence values. Each pixel of the pixels is associated with a target confidence value of the target confidence values. The method includes receiving as output from the model multiple predicted confidence values. Each predicted confidence value is associated with a pixel of the pixels. The method includes adjusting a parameter set of the model according to a loss. The loss is based on the predicted confidence values and the target confidence values.

## Claims

### Claim 1

A computer-implemented method for training a birds-eye-view (BEV) object detection model, the method comprising:
inputting a training sample into the model, wherein:
the training sample includes a BEV image including a plurality of pixels, and a plurality of target confidence values, and
each pixel of the plurality of pixels is associated with a target confidence value of the plurality of target confidence values;
receiving as output from the model a plurality of predicted confidence values, wherein each predicted confidence value is associated with a pixel of the plurality of pixels; and
adjusting a parameter set of the model according to a loss, wherein the loss is based on the plurality of predicted confidence values and the plurality of target confidence values.

### Claim 2 (depends on 1)

The method of claim 1 wherein:
a target confidence value of the plurality of target confidence values indicates an uncertainty value corresponding to the pixel of the plurality of pixels associated with the target confidence value; and
the plurality of target confidence values indicates a distribution of uncertainty values associated with the plurality of pixels.

### Claim 3 (depends on 2)

The method of claim 2 wherein a shape of the distribution of uncertainty values depends on at least one of a distance, position, rotation, size, or class of an object within the BEV image.

### Claim 4 (depends on 1)

The method of claim 1 wherein adjusting the parameter set of the model includes:
determining a subset of the plurality of predicted confidence values,
wherein the loss is based on the subset of the plurality of predicted confidence values and a corresponding subset of the plurality of target confidence values.

### Claim 5 (depends on 4)

The method of claim 4 wherein determining the subset of the plurality of predicted confidence values includes selecting the subset of the plurality of predicted confidence values based on label information associated with a subset of the plurality of pixels corresponding to the subset of the plurality of predicted confidence values.

### Claim 6 (depends on 4)

The method of claim 4 wherein determining the subset of the plurality of predicted confidence values includes selecting the subset of the plurality of predicted confidence values based on sensor information associated with a subset of the plurality of pixels corresponding to the subset of the plurality of predicted confidence values.

### Claim 7 (depends on 4)

The method of claim 4 wherein determining the subset of the plurality of predicted confidence values includes:
selecting the subset of the plurality of predicted confidence values based on a plurality of object detection scores,
wherein each object detection score of the plurality of object detection scores is associated with a pixel of a subset of the plurality of pixels corresponding to the subset of the plurality of predicted confidence values.

### Claim 8 (depends on 1)

The method of claim 1 wherein:
the training sample includes a plurality of target value sets;
each pixel of the plurality of pixels is associated with a target value set of the plurality of target value sets;
the output of the model includes a plurality of predicted value sets; and
adjusting the parameter set of the model is based on a loss between the plurality of predicted value sets and the plurality of target value sets.

### Claim 9 (depends on 1)

The method of claim 1 wherein at least one of:
each pixel of the plurality of pixels is associated with an angle value and a distance value within the BEV image; or
each pixel of the plurality of pixels is associated with first cartesian coordinate and a second cartesian coordinate.

### Claim 10 (depends on 1)

A computer-implemented method for BEV object detection, the method comprising:
the method of claim 1;
obtaining a new BEV image including a plurality of pixels;
inputting the new BEV image into the model;
receiving, from the model, an output including at least a plurality of predicted confidence values; and
detecting an object within the new BEV image using the output of the model.

### Claim 11 (depends on 10)

The method of claim 10 wherein:
the output of the model includes a plurality of predicted value sets; and
detecting the object within the BEV image includes applying the plurality of predicted confidence values on the plurality of predicted value sets.

### Claim 12

An apparatus comprising:
memory storing instructions; and
at least one processor configured to execute the instructions, wherein the instructions include:
inputting a training sample into a birds-eye-view (BEV) object detection model, wherein:
the training sample includes a BEV image including a plurality of pixels, and a plurality of target confidence values, and
each pixel of the plurality of pixels is associated with a target confidence value of the plurality of target confidence values,
receiving as output from the model at least a plurality of predicted confidence values, wherein each predicted confidence value is associated with a pixel of the plurality of pixels, and
adjusting a parameter set of the model according to a loss, wherein the loss is based at least on the plurality of predicted confidence values and the plurality of target confidence values.

### Claim 13 (depends on 12)

The apparatus of claim 12 wherein the instructions include:
obtaining a new BEV image including a plurality of pixels;
inputting the new BEV image into the model;
receiving, from the model, an output including at least a plurality of predicted confidence values; and
detecting an object within the new BEV image using the output of the model.

### Claim 14 (depends on 13)

A vehicle comprising the apparatus of claim 13.

### Claim 15 (depends on 12)

A vehicle comprising the apparatus of claim 12.

### Claim 16

A non-transitory computer-readable medium comprising a birds-eye-view (BEV) object detection model trained by a method including:
inputting a training sample into the model, wherein:
the training sample includes a BEV image including a plurality of pixels, and a plurality of target confidence values, and
each pixel of the plurality of pixels is associated with a target confidence value of the plurality of target confidence values;
receiving as output from the model a plurality of predicted confidence values, wherein each predicted confidence value is associated with a pixel of the plurality of pixels; and
adjusting a parameter set of the model according to a loss, wherein the loss is based on the plurality of predicted confidence values and the plurality of target confidence values.
