# US 2021/0342238 A1 · Method and device for testing a technical system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342238 A1
- Document ID: US20210342238A1
- Status: Published application
- Kind: A1
- Application number: 17/196,644
- Filed: 2021-03-09
- Published: 2021-11-04
- Earliest claimed: 2020-04-30
- Assignees: Robert Bosch GmbH
- Applicants: Robert Bosch GmbH
- Inventors: Christoph Gladisch; Daniel Seiler-Thull; Ji Su Yoon; Philipp Glaser; Thomas Heinz; Joachim Sohns
- Web page: https://patentgrep.com/patent/US20210342238A1

## CPC

- G06F 11/261: {by simulating additional hardware, e.g. fault simulation}
- G06F 11/0772: {Means for error signaling, e.g. using interrupts, exception flags, dedicated error registers}
- G06F 11/2257: {using expert systems}
- G06F 11/2268: {Logging of test results}
- G06F 11/263: Generation of test inputs, e.g. test vectors, patterns or sequences {; with adaptation of the tested hardware for testability with external testers}
- G06F 18/2193: {based on specific statistical tests}
- G06F 18/2413: based on distances to training or reference patterns
- G06F 18/24765: {Rule-based classification}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method for testing a technical system. The method includes: tests are carried out with the aid of a simulation of the system, the tests are evaluated with respect to a fulfillment measure of a quantitative requirement on the system and an error measure of the simulation, on the basis of the fulfillment measure and error measure, a classification of the tests as either reliable or unreliable is carried out, and a test database is improved on the basis of the classification.

## Claims

### Claim 1

A method for testing a technical system, comprising the following steps:
carrying out tests using a simulation of the system;
evaluating the tests with respect to a fulfillment measure of a quantitative requirement on the system and an error measure of the simulation;
based on the fulfillment measure and the error measure, carrying out a classification of the tests as either reliable or unreliable; and
improving a test database based on the classification.

### Claim 2 (depends on 1)

The method as recited in claim 1, wherein the technical system is an at least semi-autonomous robot or vehicle.

### Claim 3 (depends on 1)

The method as recited in claim 1, wherein:
the classification is carried out by a classifier based on a feature vector; and
the fulfillment measure and the error measure form components of the feature vector.

### Claim 4 (depends on 3)

The method as recited in claim 3, wherein:
the classifier maps the feature vector on one of multiple classes; and
the classification takes place within predefined decision limits between the classes.

### Claim 5 (depends on 4)

The method as recited in claim 4, wherein:
in a preparation phase, the simulation is confirmed by an experimental measurement on the system; and
the decision limits are drawn in such a way that the fulfillment measure taken, on the one hand, in the simulation and, on the other hand, in the measurement deviates as little as possible.

### Claim 6 (depends on 5)

The method as recited in claim 5, wherein further tests to be carried out in the preparation phase are selected automatically.

### Claim 7 (depends on 4)

The method as recited in claim 4, wherein:
the classifier is defined by solving an equation system; and
the equation system includes definition equations of the fulfillment measure and the error measure.

### Claim 8 (depends on 1)

The method as recited in claim 1, wherein the evaluation is carried out in such a way that the fulfillment measure is positive when the system meets the requirement, and negative when the system fails the requirement.

### Claim 9 (depends on 1)

The method as recited in claim 1, wherein:
for specific parameters each of the tests, the fulfillment measure and the error measure are each represented in a feature space spanned by the parameters; and
after the evaluation, the classification is visualized in the feature space.

### Claim 10 (depends on 1)

The method as recited in claim 1, wherein an automatic improvement of errors of the system recognized by the testing takes place.

### Claim 11

A non-transitory machine-readable storage medium on which is stored a computer program for testing a technical system, the computer program, when executed by a computer, causing the computer to perform the following steps:
carrying out tests using a simulation of the system;
evaluating the tests with respect to a fulfillment measure of a quantitative requirement on the system and an error measure of the simulation;
based on the fulfillment measure and the error measure, carrying out a classification of the tests as either reliable or unreliable; and
improving a test database based on the classification.

### Claim 12

A device configured to test a technical system, the device configured to:
carry out tests using a simulation of the system;
evaluate the tests with respect to a fulfillment measure of a quantitative requirement on the system and an error measure of the simulation;
based on the fulfillment measure and the error measure, carry out a classification of the tests as either reliable or unreliable; and
improve a test database based on the classification.
