# US 2017/0371773 A1 · Optimizing Execution Order of System Interval Dependent Test Cases

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0371773 A1
- Document ID: US20170371773A1
- Status: Published application
- Kind: A1
- Application number: 15/189,348
- Filed: 2016-06-22
- Published: 2017-12-28
- Earliest claimed: 2016-06-22
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Joseph W. Gentile; Brian D. Keuling; Anthony T. Sofia
- Web page: https://patentgrep.com/patent/US20170371773A1

## CPC

- G06F 11/3688: {for test execution, e.g. scheduling of test suites}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems, methods, and computer-readable media for optimizing the execution order of a set of test programs that includes at least one system interval dependent test program are disclosed. The optimized execution order may be determined by identifying each non-system interval dependent test program that can be executed during each instance of a system interval without impacting execution of system interval dependent test programs. The optimized execution order minimizes a total execution time of the set of test programs.

## Claims

### Claim 1

A method for optimizing execution of a set of test cases, the method comprising:
identifying the set of test cases, the set of test cases comprising at least one system interval dependent test case;
determining a duration of a system interval;
determining a respective execution time associated with each test case in the set of test cases; and
determining, based at least in part on the duration of the system interval and the respective execution time associated with each test case, an execution order for the set of test cases, wherein the execution order specifies an order in which the set of test cases are to be executed in order to minimize a total execution time for the set of test cases.

### Claim 2 (depends on 1)

The method of claim 1, wherein the at least one system interval dependent test case comprises a first system interval dependent test case, wherein the set of test cases comprises a subset of non-system interval dependent test cases, and wherein determining the execution order comprises allocating the subset of non-system interval dependent test cases for execution during a first instance of the system interval prior to initiation of execution of the first system interval dependent test case.

### Claim 3 (depends on 2)

The method of claim 2, wherein the respective execution time associated with the first system interval dependent test case comprises a first partial execution time prior to expiration of the first instance of the system interval and a second partial execution time subsequent to expiration of the first instance of the system interval.

### Claim 4 (depends on 2)

The method of claim 2, wherein the set of test cases further comprises an additional non-system interval dependent test case, and wherein determining the execution order further comprises:
determining that the additional non-system interval dependent test case cannot be executed in a time remaining during the first instance of the system interval after execution of a last non-system interval dependent test case in the subset of non-system interval dependent test cases and prior to initiation of execution of the first system interval dependent test case; and
designating the additional non-system interval dependent test case for execution during a second instance of the system interval that begins after expiration of the first instance of the system interval.

### Claim 5 (depends on 1)

The method of claim 1, further comprising receiving test case metadata that includes an identification of the set of test cases, a respective identification of each of the at least one system interval dependent test case, an indication of the duration of the system interval, and an indication of the respective execution time associated with each test case in the set of test cases.

### Claim 6 (depends on 1)

The method of claim 1, wherein the set of test cases is a first set of test cases, the method further comprising:
monitoring execution of the first set of cases in accordance with the execution order;
determining that a particular test case in the first set of test cases failed to execute completely;
adding the particular test case to a second set of test cases to be executed; and
determining an execution order for the second set of test cases.

### Claim 7 (depends on 1)

The method of claim 1, wherein the at least one system interval dependent test case comprises a first system interval dependent test case and a second system interval dependent test case, and wherein the system interval is a first system interval, the method further comprising:
determining that the first system interval dependent test case is dependent on the first system interval; and
determining that the second system interval dependent test case is dependent on a second system interval,
wherein the duration of the first system interval is different from a duration of the second system interval.

### Claim 8

A system for optimizing execution of a set of test cases, the system comprising:
at least one memory storing computer-executable instructions; and
at least one processor configured to access the at least one memory and execute the computer-executable instructions to:
identify the set of test cases, the set of test cases comprising at least one system interval dependent test case;
determine a duration of a system interval;
determine a respective execution time associated with each test case in the set of test cases; and
determine, based at least in part on the duration of the system interval and the respective execution time associated with each test case, an execution order for the set of test cases, wherein the execution order specifies an order in which the set of test cases are to be executed in order to minimize a total execution time for the set of test cases.

### Claim 9 (depends on 8)

The system of claim 8, wherein the at least one system interval dependent test case comprises a first system interval dependent test case, wherein the set of test cases comprises a subset of non-system interval dependent test cases, and wherein the at least one processor is configured to determine the execution order by executing the computer-executable instructions to allocate the subset of non-system interval dependent test cases for execution during a first instance of the system interval prior to initiation of execution of the first system interval dependent test case.

### Claim 10 (depends on 9)

The system of claim 9, wherein the respective execution time associated with the first system interval dependent test case comprises a first partial execution time prior to expiration of the first instance of the system interval and a second partial execution time subsequent to expiration of the first instance of the system interval.

### Claim 11 (depends on 9)

The system of claim 9, wherein the set of test cases further comprises an additional non-system interval dependent test case, and wherein the at least one processor is configured to determine the execution order by executing the computer-executable instructions to:
determine that the additional non-system interval dependent test case cannot be executed in a time remaining during the first instance of the system interval after execution of a last non-system interval dependent test case in the subset of non-system interval dependent test cases and prior to initiation of execution of the first system interval dependent test case; and
designate the additional non-system interval dependent test case for execution during a second instance of the system interval that begins after expiration of the first instance of the system interval.

### Claim 12 (depends on 9)

The system of claim 9, wherein the at least one processor is further configured to execute the computer-executable instructions to receive test case metadata that includes an identification of the set of test cases, a respective identification of each of the at least one system interval dependent test case, an indication of the duration of the system interval, and an indication of the respective execution time associated with each test case in the set of test cases.

### Claim 13 (depends on 8)

The system of claim 8, wherein the at least one system interval dependent test case comprises a first system interval dependent test case and a second system interval dependent test case, and wherein the system interval is a first system interval, and wherein the at least one processor is further configured to execute the computer-executable instructions to:
determine that the first system interval dependent test case is dependent on the first system interval; and
determine that the second system interval dependent test case is dependent on a second system interval,
wherein the duration of the first system interval is different from a duration of the second system interval.

### Claim 14 (depends on 8)

The system of claim 8, wherein the set of test cases is a first set of test cases, and wherein the at least one processor is further configured to execute the computer-executable instructions to:
monitor execution of the first set of cases in accordance with the execution order;
determine that a particular test case in the first set of test cases failed to execute completely;
add the particular test case to a second set of test cases to be executed; and
determine an execution order for the second set of test cases.

### Claim 15

A computer program product for optimizing execution of a set of test cases, the computer program product comprising a non-transitory storage medium readable by a processing circuit, the storage medium storing instructions executable by the processing circuit to cause a method to be performed, the method comprising:
identifying the set of test cases, the set of test cases comprising at least one system interval dependent test case;
determining a duration of a system interval;
determining a respective execution time associated with each test case in the set of test cases; and
determining, based at least in part on the duration of the system interval and the respective execution time associated with each test case, an execution order for the set of test cases, wherein the execution order specifies an order in which the set of test cases are to be executed in order to minimize a total execution time for the set of test cases.

### Claim 16 (depends on 15)

The computer program product of claim 15, wherein the at least one system interval dependent test case comprises a first system interval dependent test case, wherein the set of test cases comprises a subset of non-system interval dependent test cases, and wherein determining the execution order comprises allocating the subset of non-system interval dependent test cases for execution during a first instance of the system interval prior to initiation of execution of the first system interval dependent test case.

### Claim 17 (depends on 16)

The computer program product of claim 16, wherein the respective execution time associated with the first system interval dependent test case comprises a first partial execution time prior to expiration of the first instance of the system interval and a second partial execution time subsequent to expiration of the first instance of the system interval.

### Claim 18 (depends on 16)

The computer program product of claim 16, wherein the set of test cases further comprises an additional non-system interval dependent test case, and wherein determining the execution order further comprises:
determining that the additional non-system interval dependent test case cannot be executed in a time remaining during the first instance of the system interval after execution of a last non-system interval dependent test case in the subset of non-system interval dependent test cases and prior to initiation of execution of the first system interval dependent test case; and
designating the additional non-system interval dependent test case for execution during a second instance of the system interval that begins after expiration of the first instance of the system interval.

### Claim 19 (depends on 15)

The computer program product of claim 15, further comprising receiving test case metadata that includes an identification of the set of test cases, a respective identification of each of the at least one system interval dependent test case, an indication of the duration of the system interval, and an indication of the respective execution time associated with each test case in the set of test cases.

### Claim 20 (depends on 15)

The computer program product of claim 15, wherein the set of test cases is a first set of test cases, the method further comprising:
monitoring execution of the first set of cases in accordance with the execution order;
determining that a particular test case in the first set of test cases failed to execute completely;
adding the particular test case to a second set of test cases to be executed; and
determining an execution order for the second set of test cases.
