# US 2021/0342257 A1 · Enhanced testing by automated reuse of test metrics

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342257 A1
- Document ID: US20210342257A1
- Status: Published application
- Kind: A1
- Application number: 16/864,674
- Filed: 2020-05-01
- Published: 2021-11-04
- Earliest claimed: 2020-05-01
- Assignees: Sap SE
- Applicants: Sap SE
- Inventors: Andreas MEIER
- Web page: https://patentgrep.com/patent/US20210342257A1

## CPC

- G06F 11/3688: {for test execution, e.g. scheduling of test suites}
- G06F 8/60: Software deployment
- G06F 8/77: Software metrics
- G06F 11/302: {where the computing system component is a software system}
- G06F 11/3409: {for performance assessment}
- G06F 11/3457: {Performance evaluation by simulation}
- G06F 11/3466: {Performance evaluation by tracing or monitoring}
- G06F 11/368: {for test version control, e.g. updating test cases to a new software version}
- G06F 11/3692: {for test results analysis}
- G06F 11/3698: Environments for analysis, debugging or testing of software
- G06F 2201/865: Monitoring of software
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Disclosed herein are system, apparatus, method, and computer program product embodiments for testing software in a continuous deployment pipeline. An embodiment operates by automatically deploying a second version of an application at an idle endpoint. The embodiment further operates by automatically testing the second version of the application by reusing test metrics associated with a first version of the application that is live at a live endpoint. The embodiment further operates by automatically determining whether the automatic testing of the second version of the application is successful and, if so, automatically setting live the second version of the application. For example, the embodiment can operate by automatically exchanging the live endpoint with the idle endpoint to set live the second version and set idle the first version, which then may be placed in termination.

## Claims

### Claim 1

A computer implemented method for testing software in a continuous deployment pipeline, comprising:
automatically deploying, by at least one processor, a second version of an application;
automatically testing, by the at least one processor, the second version of the application based on test metrics associated with a first version of the application;
automatically determining whether the automatic testing of the second version of the application is successful; and
in response to determining that the automatic testing of the second version of the application was successful, automatically setting live, by the at least one processor, the second version of the application,
wherein prior to automatically setting live the second version of the application:
the first version of the application is live and associated with a first endpoint, and
the second version of the application is idle and associated with a second endpoint; and
wherein the setting live comprises automatically exchanging, by the at least one processor, the first endpoint with the second endpoint to:
set live the second version of the application, and
set idle the first version of the application.

### Claim 2

(canceled)

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
automatically destroying, by the at least one processor, the first version of the application.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
receiving, by the at least one processor, a request to access the application; and
automatically routing, by the at least one processor, the request to the second version of the application.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
in response to automatically determining that the automatic testing of the second version of the application is unsuccessful,
automatically destroying, by the at least one processor, the second version of the application.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
receiving, by the at least one processor, a request to access the application; and
automatically routing, by the at least one processor, the request to the first version of the application.

### Claim 7 (depends on 1)

The method of claim 1, wherein the test metrics comprise a key performance indicator associated with the first version of the application.

### Claim 8 (depends on 7)

The method of claim 7, the automatically testing further comprising:
automatically testing, by at least one processor, the second version of the application based on a duplicate of the key performance indicator.

### Claim 9

A system, comprising:
a memory; and
at least one processor coupled to the memory and configured to:
automatically deploy a second version of an application;
automatically test the second version of the application based on test metrics associated with a first version of the application;
automatically determine whether the automatic testing of the second version of the application is successful; and
in response to the automatic determination that the automatic testing of the second version of the application is successful, automatically set live the second version of the application,
wherein prior to a setting live of the second version of the application:
the first version of the application is live and associated with a first endpoint, and
the second version of the application is idle and associated with a second endpoint; and
wherein to automatically set live the second version of the application, the at least one processor is configured to:
automatically exchange the first endpoint with the second endpoint to:
set live the second version of the application, and
set idle the first version of the application.

### Claim 10

(canceled)

### Claim 11 (depends on 9)

The system of claim 9, the at least one processor further configured to:
automatically destroy the first version of the application.

### Claim 12 (depends on 9)

The system of claim 9, the at least one processor further configured to:
receive a request to access the application; and
automatically route the request to the second version of the application.

### Claim 13 (depends on 9)

The system of claim 9, the at least one processor further configured to:
in response to an automatic determination that an automatic testing of the second version of the application is unsuccessful,
automatically destroy the second version of the application.

### Claim 14 (depends on 13)

The system of claim 13, the at least one processor further configured to:
receive a request to access the application; and
automatically route the request to the first version of the application.

### Claim 15 (depends on 9)

The system of claim 9, wherein the test metrics comprise a key performance indicator associated with the first version of the application.

### Claim 16 (depends on 15)

The system of claim 15, wherein to automatically test, the at least one processor is configured to:
automatically test the second version of the application based on a duplicate of the key performance indicator.

### Claim 17

A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:
automatically deploying a second version of an application;
automatically testing the second version of the application based on test metrics associated with a first version of the application;
automatically determining whether the automatic testing of the second version of the application is successful; and
in response to automatically determining that the automatic testing of the second version of the application is successful, automatically setting live the second version of the application,
wherein prior to automatically setting live the second version of the application:
the first version of the application is live and associated with a first endpoint, and
the second version of the application is idle and associated with a second endpoint; and
wherein the setting live comprises automatically exchanging the first endpoint with the second endpoint to:
set live the second version of the application, and
set idle the first version of the application.

### Claim 18

(canceled)

### Claim 19 (depends on 17)

The non-transitory computer-readable medium of claim 17, the operations further comprising:
automatically destroying, by the at least one processor, the first version of the application.

### Claim 20 (depends on 17)

The non-transitory computer-readable medium of claim 17, the operations further comprising:
in response to automatically determining that the automatic testing of the second version of the application is unsuccessful,
automatically destroying the second version of the application.
