# US 2024/0391476 A1 · Method for a continuous integration approach of driver assistance systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0391476 A1
- Document ID: US20240391476A1
- Status: Published application
- Kind: A1
- Application number: 18/619,317
- Filed: 2024-03-28
- Published: 2024-11-28
- Earliest claimed: 2023-05-23
- Assignees: Dr. Ing. h.c. F. Porsche Aktiengesellschaft
- Applicants: Dr. Ing. h.c. F. Porsche Aktiengesellschaft
- Inventors: Moritz Markofsky
- Web page: https://patentgrep.com/patent/US20240391476A1

## CPC

- B60W 50/045: {Monitoring control system parameters}
- B60W 60/001: {Planning or execution of driving tasks}
- B60W 2050/0083: {Setting, resetting, calibration}
- B60W 2050/046: {involving external transmission of data to or from the vehicle, e.g. via telemetry, satellite, Global Positioning System [GPS]}
- B60W 2556/00: Input parameters relating to data
- B60W 2756/10: Involving external transmission of data to or from the vehicle
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT

## Abstract

A method uses a continuous integration approach for improving driver assistance systems. The method uses a test data set (11) with a time series of input data and output data of the driver assistance system and is formed during driving in a real traffic. A system-under-test is formed by a continuously changed overall software. A data-driven validation is carried out at predetermined time intervals. The method simultaneously matches (14) the output of a current software version with ground-truth data (13), which results in an assessment of a performance of the current software version and continues by forming a performance statistic on all differences and their performance score and evaluating the changes to the overall software.

## Claims

### Claim 1

A method that uses a continuous integration approach for improving driver assistance systems installed in vehicles, the method comprising:
using sensors on the vehicles for measuring vehicle operating data while driving the respective vehicles in real traffic;
determining vehicle actuator settings based on the operating data sensed by the sensors;
storing the measured vehicle operating data and the vehicle actuator settings in a test data set (11) that comprises time series of input data and output data of the driver assistance system;
testing a system-under-test (12) with the test data set (11), the system-under-test (12) being formed by an overall software that is changed continuously;
performing data-driven validations repeatedly at predetermined time intervals, each iteration of the data-driven validations including the steps of:
loading a current software version of the overall software forming the system-under-test (12) onto a server;
compiling the current software version on the server into an executable computer program;
transferring the computer program to a hardware-in-the-loop test bench;
loading the test data set (11) onto the hardware-in-the-loop test bench;
running the computer program on the hardware-in-the-loop test bench while feeding the input data to the test data set;
logging differences in output between the current software version and the output data of the test data set;
simultaneously matching (14) the output of the current software version with ground-truth data (13), thereby inferring an improvement or deterioration of a performance of the current software version and assigning a performance score to the respective differences;
forming a performance statistic on all differences and their performance score;
evaluating changes in the overall software based on the performance statistic;
outputting a report; and
executing the changed overall software during controlling of a real vehicle.

### Claim 2 (depends on 1)

The method of claim 1, wherein the test data set (11) is generated from at least one of: customer vehicles that participate in normal road traffic, vehicles that participate in a test of the system-under-test in normal road traffic.

### Claim 3 (depends on 1)

The method of claim 1, wherein the test data set (11) is formed by at least one time series of data selected from: sensor data, map material, traffic conditions, and output of the driver assistance system.

### Claim 4 (depends on 1)

The method of claim 1, wherein the report lists any new system-under-test (12) errors that occurred during any one of the data-driven validation iterations.

### Claim 5 (depends on 1)

The method of claim 1, wherein the system-under-test (12) is an automated driver assistance system (ADAS) or an automated driving system (ADS).

### Claim 6 (depends on 5)

The method of claim 5, wherein system-under-test (12) is an open loop ADAS or ADS.

### Claim 7 (depends on 5)

The method of claim 5, wherein the system-under-test (12) is an open-loop ADAS or ADS that comprises at least one of traffic sign recognition, night vision, ego motion locator.

### Claim 8 (depends on 1)

The method of claim 1, further comprising testing at least one subcomponent of a closed-loop system using functional decomposition, wherein the closed-loop system comprises at least one closed-loop subcomponent and at least one open-loop subcomponent, and wherein the at least one open-loop subcomponent is selected as the at least one subcomponent to be tested.

### Claim 9 (depends on 1)

The method of claim 1, further comprising using a plurality of the test benches in parallel by partitioning the test data sets (11) into a plurality of time periods and supplying test data sets (11) to the respective test benches at the respective time periods.

### Claim 10 (depends on 1)

The method of claim 1, wherein based on the evaluating of the changes in the overall software based on the performance statistic, respective changes in the software version are discarded and a new iteration run is started.

### Claim 11 (depends on 1)

A test system that uses a continuous integration approach for improving driver assistance systems installed in vehicles, the test system comprises a server and a hardware-in-the-loop test bench having a computing unit, the computing unit being configured to execute an algorithm according to the method of claim 1.
