# US 2019/0171549 A1 · Extraction of problem diagnostic knowledge from test cases

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171549 A1
- Document ID: US20190171549A1
- Status: Published application
- Kind: A1
- Application number: 16/267,709
- Filed: 2019-02-05
- Published: 2019-06-06
- Earliest claimed: 2014-07-10
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Hariharan Krishna; Arun Ramakrishnan; Rohit Shetty
- Web page: https://patentgrep.com/patent/US20190171549A1

## CPC

- G06F 11/3698: Environments for analysis, debugging or testing of software
- G06F 8/70: Software maintenance or management
- G06F 11/3612: {by runtime analysis (performance monitoring G06F11/3466)}
- G06F 11/3676: {for coverage analysis}
- G06F 11/368: {for test version control, e.g. updating test cases to a new software version}
- G06F 11/3688: {for test execution, e.g. scheduling of test suites}
- G06F 11/3692: {for test results analysis}
- G06N 5/025: Extracting rules from data
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Embodiments of the present invention enable users to extract knowledge from testing scenarios performed during application development, and later employ that knowledge to interpret application usage scenarios to enhance serviceability of applications by expediting identification and solving of problems. In an exemplary embodiment, log data generated during simulation of test cases is analyzed to create one or more rules based on patterns in which one or more log entries appear in the log data. Later, log data may be analyzed to look for a pattern of log entries that matches a pattern-based rule, thereby facilitating faster identification and resolution of the problem.

## Claims

### Claim 1

A method, the method comprising:
creating, by one or more processors, a first rule that includes a first pattern of program activity included in a first set of log entries that are associated with (i) a test case and (ii) a first scenario under which the first set of log entries were generated; and
responsive to identification of at least a partial match between the first pattern of program activity and a second pattern of program activity, generating, by the one or more computer processors, a message that includes stored knowledge about the test case.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
generating, by the one or more processors, the second set of program activity under a second scenario.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
associating, by one or more computer processors, the first rule with information describing the first scenario.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
determining, by the one or more processors, the first pattern based on a first order of the identified one or more log entries appearing in the first set of log data, wherein the first pattern includes a content of a plurality of message identifiers that appear in the first set of log data and a chronological order in which the plurality of message identifiers appear.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
generating, by one or more computer processors, the first set of log data based, at least in part, on an execution of an application code in the first scenario.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first set of log data includes one or more log entries and a set of run-time data associated with the execution of application code in the first scenario

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
processing, by one or more computer processors, the first set of log data to identify one or more log entries appearing in the first set of log data, wherein the one or more log entries include information that was generated during execution, in the first scenario, of a set of lines of code included in an application code.

### Claim 8 (depends on 1)

The method of claim 1, wherein the stored knowledge includes a list of aspects of an application code that was tested using the test case and the first scenario.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
identifying, by one or more computer processors, in the second pattern of program activity, a second set of log entries that were generated during an execution of the application code in a second scenario; and
determining, by one or more computer processors, that the second set of log entries partially at least partially satisfies the first rule.

### Claim 10

A computer program product comprising:
a computer readable storage medium having program instructions stored thereon, the program instructions comprising:
program instructions to create a first rule that includes a first pattern of program activity included in a first set of log entries that are associated with (i) a test case and (ii) a first scenario under which the first set of log entries were generated; and
program instructions to respond to identification of at least a partial match between the first pattern of program activity and a second pattern of program activity, generating, by the one or more computer processors, a message that includes stored knowledge about the test case.

### Claim 11 (depends on 10)

The computer program product of claim 10, the program instructions further comprising:
program instructions to generate the second set of program activity under a second scenario.

### Claim 12 (depends on 10)

The computer program product of claim 10, the program instructions further comprising:
program instructions to associate the first rule with information describing the first scenario.

### Claim 13 (depends on 10)

The computer program product of claim 10, the program instructions further comprising:
program instructions to determine the first pattern based on a first order of the identified one or more log entries appearing in the first set of log data, wherein the first pattern includes a content of a plurality of message identifiers that appear in the first set of log data and a chronological order in which the plurality of message identifiers appear.

### Claim 14 (depends on 10)

The computer program product of claim 10, the program instructions further comprising:
program instructions to generate the first set of log data based, at least in part, on an execution of an application code in the first scenario.

### Claim 15 (depends on 10)

The computer program product of claim 10, wherein the first set of log data includes one or more log entries and a set of run-time data associated with the execution of application code in the first scenario.

### Claim 16 (depends on 10)

The computer program product of claim 10, the program instructions further comprising:
program instructions to process the first set of log data to identify one or more log entries appearing in the first set of log data, wherein the one or more log entries include information that was generated during execution, in the first scenario, of a set of lines of code included in an application code.

### Claim 17 (depends on 10)

The computer program product of claim 10, wherein the stored knowledge includes a list of aspects of an application code that was tested using the test case and the first scenario.

### Claim 18 (depends on 10)

The computer program product of claim 10, the program instructions further comprising:
program instructions to identify in the second pattern of program activity, a second set of log entries that were generated during an execution of the application code in a second scenario; and
program instructions to determine that the second set of log entries partially at least partially satisfies the first rule.

### Claim 19

A computer system, the computer system comprising:
one or more computer processors;
one or more computer readable storage medium; and
program instructions stored on the computer readable storage medium for execution by at least one of the one or more processors, the program instructions comprising:
program instructions to create a first rule that includes a first pattern of program activity included in a first set of log entries that are associated with (i) a test case and (ii) a first scenario under which the first set of log entries were generated; and
program instructions to respond to identification of at least a partial match between the first pattern of program activity and a second pattern of program activity, generating, by the one or more computer processors, a message that includes stored knowledge about the test case.

### Claim 20 (depends on 19)

The computer system of claim 19, the program instructions further comprising:
program instructions to generate the second set of program activity under a second scenario.
