# US 2026/0099431 A1 · Software testing with test case timeout threshold

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0099431 A1
- Document ID: US20260099431A1
- Status: Published application
- Kind: A1
- Application number: 18/906,824
- Filed: 2024-10-04
- Published: 2026-04-09
- Earliest claimed: 2024-10-04
- Assignees: Sap SE
- Applicants: Sap SE
- Inventors: Alexander Berndt; Sebastian Baltes; Wolfgang Wolesak; Thomas Bach
- Web page: https://patentgrep.com/patent/US20260099431A1

## CPC

- G06F 11/3688: {for test execution, e.g. scheduling of test suites}
- G06F 11/3692: {for test results analysis}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Various examples are directed to systems and methods for testing software applications. A system may access first test case execution data. The first test case execution data may describe a first plurality of trial test case executions against the software application with a trial timeout threshold. Based at least in part on the first test case execution data, the system may determine a timeout probability for the first plurality of trial test case executions. The system may select a first timeout threshold based at least in part on a test case execution cost associated with the first plurality of trial test case executions and at least in part on the timeout probability for the first plurality of trial test case executions. The system may execute at least one test case against the software application using the first timeout threshold.

## Claims

### Claim 1

A system for testing a software application, comprising:
at least one processor programmed to perform operations comprising:
accessing first test case execution data, the first test case execution data describing a first plurality of trial test case executions against the software application with a trial timeout threshold;
based at least in part on the first test case execution data, determining a timeout probability for the first plurality of trial test case executions;
selecting a first timeout threshold based at least in part on a test case execution cost associated with the first plurality of trial test case executions and at least in part on the timeout probability for the first plurality of trial test case executions; and
executing at least one test case against the software application using the first timeout threshold.

### Claim 2 (depends on 1)

The system of claim 1, the first plurality of trial test case executions comprising executions of a first test case against the software application and executions of a second test case against the software application, the executing of the at least one test case against the software application comprising:
executing the first test case against the software application using the first timeout threshold; and
executing the second test case against the software application using the first timeout threshold.

### Claim 3 (depends on 1)

The system of claim 1, the executing of the at least one test case against the software application using the first timeout threshold comprising executing a first test case against the software application using the first timeout threshold, the operations further comprising:
data describing a second plurality of trial test case executions of a second test case against the software application with the trial timeout threshold;
based at least in part on the second test case execution data, determining a timeout probability for the second test case;
selecting a second timeout threshold based at least in part on a test case execution cost associated with the second test case and at least in part on the timeout probability for the second test case; and
executing the second test case against the software application using the second timeout threshold.

### Claim 4 (depends on 1)

The system of claim 1, the selecting of the first timeout threshold comprising selecting the first timeout threshold to minimize the test case execution cost associated with the first plurality of trial test case executions.

### Claim 5 (depends on 4)

The system of claim 4, the operations further comprising:
determining an expression of the test case execution cost, the expression of the test case execution cost being based at least in part on a mean execution time of the first plurality of trial test case executions, a re-execution time for timed-out test case executions, and the timeout probability for the first plurality of trial test case executions; and
selecting the first timeout threshold to minimize the expression of the test case execution cost with the timeout probability.

### Claim 6 (depends on 1)

The system of claim 1, the selecting of the first timeout threshold also being based at least in part on a re-execution time for timed-out test case executions.

### Claim 7 (depends on 6)

The system of claim 6, the re-execution time for timed-out test case executions being based at least in part on a number of re-executions performed for timed-out test case executions.

### Claim 8 (depends on 1)

The system of claim 1, the selecting of the first timeout threshold also being based at least in part on a manual review time for manually reviewing results of timed-out test cases.

### Claim 9 (depends on 1)

The system of claim 1, the first timeout threshold being less than the trial timeout threshold.

### Claim 10

A method of testing a software application, comprising:
accessing first test case execution data, the first test case execution data describing a first plurality of trial test case executions against the software application with a trial timeout threshold;
based at least in part on the first test case execution data, determining a timeout probability for the first plurality of trial test case executions;
selecting a first timeout threshold based at least in part on a test case execution cost associated with the first plurality of trial test case executions and at least in part on the timeout probability for the first plurality of trial test case executions; and
executing at least one test case against the software application using the first timeout threshold.

### Claim 11 (depends on 10)

The method of claim 10, the first plurality of trial test case executions comprising executions of a first test case against the software application and executions of a second test case against the software application, the executing of the at least one test case against the software application comprising:
executing the first test case against the software application using the first timeout threshold; and
executing the second test case against the software application using the first timeout threshold.

### Claim 12 (depends on 10)

The method of claim 10, the executing of the at least one test case against the software application using the first timeout threshold comprising executing a first test case against the software application using the first timeout threshold, the method further comprising:
data describing a second plurality of trial test case executions of a second test case against the software application with the trial timeout threshold;
based at least in part on the second test case execution data, determining a timeout probability for the second test case;
selecting a second timeout threshold based at least in part on a test case execution cost associated with the second test case and at least in part on the timeout probability for the second test case; and
executing the second test case against the software application using the second timeout threshold.

### Claim 13 (depends on 10)

The method of claim 10, the selecting of the first timeout threshold comprising selecting the first timeout threshold to minimize the test case execution cost associated with the first plurality of trial test case executions.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
determining an expression of the test case execution cost, the expression of the test case execution cost being based at least in part on a mean execution time of the first plurality of trial test case executions, a re-execution time for timed-out test case executions, and the timeout probability for the first plurality of trial test case executions; and
selecting the first timeout threshold to minimize the expression of the test case execution cost with the timeout probability.

### Claim 15 (depends on 10)

The method of claim 10, the selecting of the first timeout threshold also being based at least in part on a re-execution time for timed-out test case executions.

### Claim 16 (depends on 15)

The method of claim 15, the re-execution time for timed-out test case executions being based at least in part on a number of re-executions performed for timed-out test case executions.

### Claim 17 (depends on 10)

The method of claim 10, the selecting of the first timeout threshold also being based at least in part on a manual review time for manually reviewing results of timed-out test cases.

### Claim 18 (depends on 10)

The method of claim 10, the first timeout threshold being less than the trial timeout threshold.

### Claim 19

A non-transitory machine-readable medium comprising instructions thereon that, when executed by at least one processor, because the at least one processor to perform operations comprising:
accessing first test case execution data, the first test case execution data describing a first plurality of trial test case executions against a software application with a trial timeout threshold;
based at least in part on the first test case execution data, determining a timeout probability for the first plurality of trial test case executions;
selecting a first timeout threshold based at least in part on a test case execution cost associated with the first plurality of trial test case executions and at least in part on the timeout probability for the first plurality of trial test case executions; and
executing at least one test case against the software application using the first timeout threshold.

### Claim 20 (depends on 19)

The non-transitory machine-readable medium of claim 19, the first plurality of trial test case executions comprising executions of a first test case against the software application and executions of a second test case against the software application, the executing of the at least one test case against the software application comprising:
executing the first test case against the software application using the first timeout threshold; and
executing the second test case against the software application using the first timeout threshold.
