# US 2023/0274590 A1 · Scalable sensor analysis for vehicular driving assistance system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274590 A1
- Document ID: US20230274590A1
- Status: Published application
- Kind: A1
- Application number: 18/173,829
- Filed: 2023-02-24
- Published: 2023-08-31
- Earliest claimed: 2022-02-25
- Assignees: Magna Electronics Inc.
- Applicants: Magna Electronics Inc.
- Inventors: Sagar Sheth; Florian Nübling; Nico Schlucke
- Web page: https://patentgrep.com/patent/US20230274590A1

## CPC

- G07C 5/0808: {Diagnosing performance data (testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005)}
- G07C 5/0841: {Registering performance data (recording measured values G01D; information storage G11B)}
- G06V 10/84: using probabilistic graphical models from image or video features, e.g. Markov models or Bayesian networks
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations
- B60W 50/045: {Monitoring control system parameters}
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT

## Abstract

A method for testing a vehicular driver assistance system includes recording sensor data from a sensor of a vehicle equipped with the vehicular driver assistance system and annotating the recorded sensor data. The annotations represent a predicted output of a processor when processing the recorded sensor data for the vehicular driver assistance system. The recorded sensor data and the annotated sensor data are stored at data storage. Analysis data is generated based on statistical analysis of the recorded sensor data and the statistical analysis of the annotated sensor data. The analysis data is stored at a results database. A key performance indicator (KPI) report is generated using the analysis data. The KPI report includes a dynamic graphic representation based on the analysis data.

## Claims

### Claim 1

A method for testing a vehicular driver assistance system, the method comprising:
recording sensor data from a sensor of a vehicle equipped with the vehicular driver assistance system, the vehicular driver assistance system comprising a processor for processing recorded sensor data;
annotating the recorded sensor data, the annotations representing a predicted output of the processor when the processor is processing the recorded sensor data for the vehicular driver assistance system;
storing the recorded sensor data and the annotated sensor data at data storage;
generating analysis data based on statistical analysis of the recorded sensor data and statistical analysis of the annotated sensor data;
storing the analysis data at a results database; and
generating, using the stored analysis data, a key performance indicator (KPI) report, wherein the KPI report comprises a dynamic graphic representation based on the analysis data.

### Claim 2 (depends on 1)

The method of claim 1, wherein a distributed computing system performs the statistical analysis.

### Claim 3 (depends on 1)

The method of claim 1, wherein the annotated sensor data and the results database are stored on distributed storage.

### Claim 4 (depends on 1)

The method of claim 1, wherein the sensor comprises a camera, and wherein the recorded sensor data comprises image data captured by the camera.

### Claim 5 (depends on 1)

The method of claim 1, wherein the dynamic graphic representation comprises a driving scene.

### Claim 6 (depends on 5)

The method of claim 5, wherein the driving scene comprises a model of the equipped vehicle and a model of at least one other object.

### Claim 7 (depends on 6)

The method of claim 6, wherein the model of the equipped vehicle and the model of the at least one other object are three-dimensional models, and wherein the model of the at least one other object is located relative to the model of the equipped vehicle based on the recorded sensor data.

### Claim 8 (depends on 6)

The method of claim 6, wherein the at least one other object comprises at least one selected from the group consisting of (i) another vehicle, (ii) a pedestrian, and (iii) a lane marker.

### Claim 9 (depends on 1)

The method of claim 1, wherein generating the analysis data comprises using a MapReduce model.

### Claim 10 (depends on 1)

The method of claim 1, wherein generating the analysis data comprises executing a data analytics engine within a cloud container.

### Claim 11 (depends on 1)

The method of claim 1, further comprising receiving annotations for annotating the recorded sensor data via a representational state transfer (REST) application programming interface (API).

### Claim 12 (depends on 1)

The method of claim 1, wherein the results database comprises a document based database.

### Claim 13 (depends on 1)

The method of claim 1, wherein the KPI report comprises, for each respective test case of a plurality of test cases, a result of the respective test case.

### Claim 14 (depends on 1)

The method of claim 1, wherein the sensor comprises a radar sensor, and wherein the recorded sensor data comprises radar data captured by the radar sensor.

### Claim 15 (depends on 1)

The method of claim 1, wherein the vehicular driver assistance system comprises one selected from the group consisting of (i) traffic sign recognition, (ii) headlamp control, (iii) pedestrian detection, (iv) collision avoidance, and (v) lane marker detection.

### Claim 16 (depends on 1)

The method of claim 1, wherein the method further comprises training, using the annotated sensor data, a machine learning model of the vehicular driver assistance system.

### Claim 17

A method for testing a vehicular driver assistance system, the method comprising:
recording image data from a forward-viewing camera disposed at a windshield of a vehicle equipped with the vehicular driver assistance system, the vehicular driver assistance system comprising an image processor for processing recorded image data;
annotating the recorded image data, the annotations representing a predicted output of the image processor when processing the recorded image data for the vehicular driver assistance system;
storing the recorded image data and the annotated image data at data storage;
generating analysis data based on statistical analysis of the recorded image data and statistical analysis of the annotated image data;
storing the analysis data at a results database; and
generating, using the stored analysis data, a key performance indicator (KPI) report, wherein the KPI report comprises a dynamic graphic representation based on the analysis data, and wherein the dynamic graphic representation comprises a driving scene comprising at least one model.

### Claim 18 (depends on 17)

The method of claim 17, wherein the at least one model comprises a model of the equipped vehicle and a model of at least one other object.

### Claim 19 (depends on 18)

The method of claim 18, wherein the model of the equipped vehicle and the model of the at least one other object are three-dimensional models, and wherein the model of the at least one other object is located relative to the model of the equipped vehicle based on the recorded image data.

### Claim 20 (depends on 18)

The method of claim 18, wherein the at least one other object comprises at least one selected from the group consisting of (i) another vehicle, (ii) a pedestrian, and (iii) a lane marker.

### Claim 21

A method for testing a vehicular driver assistance system, the method comprising:
recording radar data from at least one radar sensor of a vehicle equipped with the vehicular driver assistance system, the vehicular driver assistance system comprising a processor for processing recorded radar data;
annotating the recorded radar data, the annotations representing a predicted output of a processor when processing the recorded radar data for the vehicular driver assistance system;
storing the recorded radar data and the annotated radar data at data storage;
generating analysis data based on statistical analysis of the recorded radar data and statistical analysis of the annotated radar data;
storing the analysis data at a results database; and
generating, using the stored analysis data, a key performance indicator (KPI) report, wherein the KPI report comprises a dynamic graphic representation based on the analysis data, and wherein the KPI report comprises, for each respective test case of a plurality of test cases, a result of the respective test case.

### Claim 22 (depends on 21)

The method of claim 21, wherein, further comprising recording image data from at least one camera of a vehicle equipped with the vehicular driver assistance system, and wherein generating the analysis data is further based on the recorded image data.

### Claim 23 (depends on 21)

The method of claim 21, wherein generating the analysis data comprises using a MapReduce model.
