# US 2019/0171551 A1 · Gray-box testing based on concrete usages

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171551 A1
- Document ID: US20190171551A1
- Status: Published application
- Kind: A1
- Application number: 15/828,480
- Filed: 2017-12-01
- Published: 2019-06-06
- Earliest claimed: 2017-12-01
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Jim A. Laredo; Aleksander Slominski; John E. Wittern; Annie T. Ying; Christopher C. Young; Yunhui Zheng
- Web page: https://patentgrep.com/patent/US20190171551A1

## CPC

- G06F 11/3684: {for test design, e.g. generating new test cases}
- G06F 11/3414: {Workload generation, e.g. scripts, playback}
- G06F 11/3688: {for test execution, e.g. scheduling of test suites}
- G06F 8/433: {Dependency analysis; Data or control flow analysis}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A computer implemented method for testing an application according to usage data includes receiving an application to be tested and a set of usage data corresponding to the application to be tested, wherein the set of usage data corresponds to previously executed code sequences, identifying one or more code sequences of interest corresponding to the received application, wherein the code sequences of interest correspond to codes sequences that are configured to exercise the received application, extracting concrete usages of the code sequence of interest from the received set of usage data, generating one or more test cases for the application according to the extracted usages, and providing the one or more generated test cases. The method may additionally include testing the application according to the one or more generated test cases.

## Claims

### Claim 1

A computer implemented method for testing an application according to usage data, the method comprising:
receiving an application to be tested and a set of usage data corresponding to the application to be tested, wherein the set of usage data is sourced from code repositories that make use of the received application;
identifying one or more code sequences of interest corresponding to the received application, wherein the code sequences of interest correspond to codes sequences that are configured to exercise the received application;
extracting concrete usages of the code sequence of interest from the received set of usage data;
generating one or more test cases for the application according to the extracted usages; and
outputting the one or more generated test cases.

### Claim 2 (depends on 1)

The computer implemented method of claim 1, further comprising identifying one or more dependencies corresponding to the extracted concrete usages of the code sequence of interest.

### Claim 3 (depends on 1)

The computer implemented method of claim 1, further comprising identifying one or more parameters corresponding to the extracted concrete usages of the code sequence of interest.

### Claim 4 (depends on 3)

The computer implemented method of claim 3, wherein generating one or more test cases for the application according to the extracted usages includes generating test cases configured to test the application with respect to the identified one or more parameters corresponding to the extracted concrete usages.

### Claim 5 (depends on 1)

The computer implemented method of claim 1, wherein identifying one or more code sequences of interest includes searching for invocations executed with respect to the received application.

### Claim 6 (depends on 1)

The computer implemented method of claim 1, wherein providing the one or more generated test cases includes generating a report that indicates a set of parameters or dependencies being tested by each generated test case.

### Claim 7 (depends on 1)

The computer implemented method of claim 1, further comprising executing the generated test according to the one or more generated test cases.

### Claim 8 (depends on 2)

The computer implemented method of claim 2, wherein generating one or more test cases for the application according to the extracted usages includes generating test cases configured to test the application with respect to the identified one or more dependencies corresponding to the extracted concrete usages.

### Claim 9

A computer program product for testing an application according to usage data, the computer program product comprising:
one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising instructions to:
receive an application to be tested and a set of usage data corresponding to the application to be tested, wherein the set of usage data is sourced from code repositories that make use of the received application;
identify one or more code sequences of interest corresponding to the received application, wherein the code sequences of interest correspond to codes sequences that are configured to exercise the received application;
extract concrete usages of the code sequence of interest from the received set of usage data;
generate one or more test cases for the application according to the extracted usages; and
output the one or more generated test cases.

### Claim 10 (depends on 9)

The computer program product of claim 9, further comprising instructions to identify one or more dependencies corresponding to the extracted concrete usages of the code sequence of interest.

### Claim 11 (depends on 9)

The computer program product of claim 9, further comprising instructions to identify one or more parameters corresponding to the extracted concrete usages of the code sequence of interest.

### Claim 12 (depends on 11)

The computer program product of claim 11, wherein generating one or more test cases for the application according to the extracted usages includes generating test cases configured to test the application with respect to the identified one or more parameters corresponding to the extracted concrete usages.

### Claim 13 (depends on 9)

The computer program product of claim 9, wherein instructions to identify one or more code sequences of interest comprise instructions to search for invocations executed with respect to the received application.

### Claim 14 (depends on 9)

The computer program product of claim 9, wherein instructions to provide the one or more generated test cases comprise instructions to generate a report that indicates a set of parameters or dependencies being tested by each generated test case.

### Claim 15

A computer system for testing an application according to usage data, the computer program product comprising:
one or more computer processors;
one or more computer readable storage media;
program instructions stored on the one or more computer readable storage media, the program instructions comprising instructions to:
receive an application to be tested and a set of usage data corresponding to the application to be tested, wherein the set of usage data is sourced from code repositories that make use of the received application;
identify one or more code sequences of interest corresponding to the received application, wherein the code sequences of interest correspond to codes sequences that are configured to exercise the received application;
extract concrete usages of the code sequence of interest from the received set of usage data;
generate one or more test cases for the application according to the extracted usages; and
output the one or more generated test cases.

### Claim 16 (depends on 15)

The computer system of claim 15, further comprising instructions to identify one or more dependencies corresponding to the extracted concrete usages of the code sequence of interest.

### Claim 17 (depends on 15)

The computer system of claim 15, further comprising instructions to identify one or more parameters corresponding to the extracted concrete usages of the code sequence of interest.

### Claim 18 (depends on 17)

The computer system of claim 17, wherein generating one or more test cases for the application according to the extracted usages includes generating test cases configured to test the application with respect to the identified one or more parameters corresponding to the extracted concrete usages.

### Claim 19 (depends on 15)

The computer system of claim 15, wherein instructions to identify one or more code sequences of interest comprise instructions to search for invocations executed with respect to the received application.

### Claim 20 (depends on 15)

The computer system of claim 15, wherein instructions to provide the one or more generated test cases comprise instructions to generate a report that indicates a set of parameters or dependencies being tested by each generated test case.
