# US 2024/0202548 A1 · Methods and systems for determining a conversion rule

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202548 A1
- Document ID: US20240202548A1
- Status: Published application
- Kind: A1
- Application number: 18/537,053
- Filed: 2023-12-12
- Published: 2024-06-20
- Earliest claimed: 2022-12-14
- Assignees: Aptiv Technologies AG
- Applicants: Aptiv Technologies AG
- Inventors: Zhiheng NIU; Markus SCHOELER; Yu SU
- Web page: https://patentgrep.com/patent/US20240202548A1

## CPC

- G06N 5/022: Knowledge engineering; Knowledge acquisition
- G06V 10/776: Validation; Performance evaluation
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A computer implemented method for determining a conversion rule for an object prediction model may include the following steps carried out by computer hardware components: determining a plurality of predictions based on sensor data using the object prediction model, wherein each prediction may include a respective prediction value and a respective confidence value of the respective prediction value; determining the conversion rule for the object prediction model by carrying out the following steps: determining a plurality of sampling values for assessing a performance of the object prediction model; for each sampling value of the plurality of sampling values, determining a corresponding statistical value based on ground-truth data and the plurality of confidence values, wherein the ground-truth data may be associated with the sensor data; and determining the conversion rule for the object prediction model based on the plurality of sampling values and the plurality of corresponding statistical values.

## Claims

### Claim 1

A computer implemented method for determining a conversion rule for an object prediction model, the method comprising the following steps carried out by computer hardware components:
determining a plurality of predictions based on sensor data using the object prediction model, wherein each prediction comprises a respective prediction value and a respective confidence value of the respective prediction value;
determining the conversion rule for the object prediction model by carrying out the following steps:
determining a plurality of sampling values for assessing a performance of the object prediction model;
for each sampling value of the plurality of sampling values, determining a corresponding statistical value based on ground-truth data and the plurality of confidence values, wherein the ground-truth data is associated with the sensor data; and
determining the conversion rule for the object prediction model based on the plurality of sampling values and the plurality of corresponding statistical values.

### Claim 2 (depends on 1)

The method of claim 1,
wherein the plurality of sampling values corresponds to the plurality of confidence values.

### Claim 3 (depends on 1)

The method of claim 1,
wherein each statistical value of the plurality of statistical values comprises a true-positive rate corresponding to the respective sampling value.

### Claim 4 (depends on 1)

The method of claim 1, further comprising the following steps carried out by computer hardware components:
filtering the ground-truth data based on a condition, wherein the condition is at least one of an object class, a scene type, or bounding box properties; and
for each sampling value of the plurality of sampling values, determining the corresponding statistical value based on the filtered ground-truth data and the plurality of confidence values.

### Claim 5 (depends on 1)

The method of claim 1, wherein the prediction values comprise data describing the respective prediction associated to an object class of a plurality of object classes.

### Claim 6 (depends on 1)

The method of claim 1, wherein the prediction values comprise data describing the respective prediction associated to bounding box properties.

### Claim 7 (depends on 1)

The method of claim 1, further comprising the following steps carried out by computer hardware components:
for each sampling value of the plurality of sampling values:
determining a first number as a number of predictions with a respective confidence value greater or equal than the sampling value;
determining a second number as a number of predictions with a respective confidence value greater or equal than the sample value, wherein the predictions with a respective confidence value greater or equal than the sample value correspond to a corresponding object in the ground-truth data; and
determining the statistical value by dividing the second number by the first number.

### Claim 8 (depends on 1)

The method of claim 1, wherein determining the conversion rule comprises a fitting of the conversion rule to the plurality of sampling values and the plurality of corresponding statistical values.

### Claim 9 (depends on 8)

The method of claim 8, wherein the fitting of the conversion rule to the plurality of sampling values and the plurality of corresponding statistical values comprises using a regression method.

### Claim 10 (depends on 8)

The method of claim 8, wherein the fitting of the conversion rule approximates a curve based on a plurality of scores, wherein each score of the plurality of scores represents a statistical value of the plurality of statistical values and the corresponding sampling value of the plurality of sampling values.

### Claim 11 (depends on 8)

The method of claim 8, wherein each score comprises a minimum distance to the curve.

### Claim 12 (depends on 1)

The method of claim 1, further comprising the following step carried out by computer hardware components:
applying the conversion rule to an output of an object prediction model.

### Claim 13 (depends on 12)

The method of claim 12, further comprising the following step carried out by computer hardware components:
determining a tracker parameter for a unified tracking module based on the conversion rule such that the unified tracking module is applicable to the object prediction model.

### Claim 14 (depends on 13)

The method of claim 13, wherein the output of the object prediction model once applied to the conversion rule is used as input to the unified tracking module.

### Claim 15

A computer system comprising a plurality of computer hardware components configured to determine a conversion rule for an object prediction model, the computer hardware components being configured to:
determine a plurality of predictions based on sensor data using the object prediction model, wherein each prediction comprises a respective prediction value and a respective confidence value of the respective prediction value;
determine the conversion rule for the object prediction model by carrying out the following steps:
determining a plurality of sampling values for assessing a performance of the object prediction model;
for each sampling value of the plurality of sampling values, determining a corresponding statistical value based on ground-truth data and the plurality of confidence values, wherein the ground-truth data is associated with the sensor data; and
determining the conversion rule for the object prediction model based on the plurality of sampling values and the plurality of corresponding statistical values.

### Claim 16 (depends on 15)

A vehicle that includes the computer system of claim 15 and at least one sensor.

### Claim 17 (depends on 15)

The computer system of claim 15, wherein the computer hardware components are further configured to apply the conversion rule to an output of an object prediction model.

### Claim 18

A non-transitory computer readable medium storing instructions that, when executed by a computer, cause the computer to determine a conversion rule for an object prediction model by:
determining a plurality of predictions based on sensor data using the object prediction model, wherein each prediction comprises a respective prediction value and a respective confidence value of the respective prediction value;
determining the conversion rule for the object prediction model by carrying out the following steps:
determining a plurality of sampling values for assessing a performance of the object prediction model;
for each sampling value of the plurality of sampling values, determining a corresponding statistical value based on ground-truth data and the plurality of confidence values, wherein the ground-truth data is associated with the sensor data; and
determining the conversion rule for the object prediction model based on the plurality of sampling values and the plurality of corresponding statistical values.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein the instructions further cause the computer to apply the conversion rule to an output of an object prediction model.
