Reliability index in software testing
AssigneeInternational Business Machines Corporation
InventorsVikas Chandra, Sarika Sinha
Life of this patent
Estimating the term…
Abstract
Described are techniques for software test reliability characterization. The techniques include receiving a test failure for a software under development in an Integrated Development Environment (IDE). The techniques further include identifying, from a software testing repository communicatively coupled to the IDE, a similar failed software test. The techniques further include applying a reliability index of the similar failed software test to the test failure. The techniques further include displaying, on a graphical user interface communicatively coupled to the IDE, a graphical illustration indicating the reliability index associated with the test failure.
Claims20
A computer-implemented method comprising:
- receiving a test failure for a software under development in an Integrated Development Environment (IDE);
- identifying, from a software testing repository communicatively coupled to the IDE, a similar failed software test;
- applying a reliability index of the similar failed software test to the test failure, wherein the reliability index is based on a recency of test failures, a ratio of fail to pass test cases, a frequency of test failures, and a duration of test failures;
- predicting a cause of the similar failed software test by:
- collecting pass/fail data for the similar failed software test when altering an order of operations in the similar failed software test;
- collecting pass/fail data for the similar failed software test when changing an operating system implementing the similar failed software test;
- collecting pass/fail data for the similar failed software test when applying intermittent delays during execution of the similar failed software test;
- and
- collecting pass/fail data for the similar failed software test when altering computational environment parameters of the similar failed software test;
- and
- displaying, on a graphical user interface communicatively coupled to the IDE, a graphical illustration indicating the reliability index associated with the test failure and a predicted cause of the test failure based on the predicted cause of the similar failed software test.
A system comprising:
- one or more processors;
- and
- one or more computer-readable storage media storing program instructions which, when executed by the one or more processors, are configured to cause the one or more processors to perform a method comprising:
- receiving a test failure for a software under development in an Integrated Development Environment (IDE);
- identifying, from a software testing repository communicatively coupled to the IDE, a similar failed software test;
- applying a reliability index of the similar failed software test to the test failure, wherein the reliability index is based on a recency of test failures, a ratio of fail to pass test cases, a frequency of test failures, and a duration of test failures;
- predicting a cause of the similar failed software test by:
- collecting pass/fail data for the similar failed software test when altering an order of operations in the similar failed software test;
- collecting pass/fail data for the similar failed software test when changing an operating system implementing the similar failed software test;
- collecting pass/fail data for the similar failed software test when applying intermittent delays during execution of the similar failed software test;
- and
- collecting pass/fail data for the similar failed software test when altering computational environment parameters of the similar failed software test;
- and
- displaying, on a graphical user interface communicatively coupled to the IDE, a graphical illustration indicating the reliability index associated with the test failure and a predicted cause of the test failure based on the predicted cause of the similar failed software test.
A computer program product comprising one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions comprising instructions configured to cause one or more processors to perform a method comprising:
- receiving a test failure for a software under development in an Integrated Development Environment (IDE);
- identifying, from a software testing repository communicatively coupled to the IDE, a similar failed software test;
- applying a reliability index of the similar failed software test to the test failure, wherein the reliability index is based on a recency of test failures, a ratio of fail to pass test cases, a frequency of test failures, and a duration of test failures;
- predicting a cause of the similar failed software test by:
- collecting pass/fail data for the similar failed software test when altering an order of operations in the similar failed software test;
- collecting pass/fail data for the similar failed software test when changing an operating system implementing the similar failed software test;
- collecting pass/fail data for the similar failed software test when applying intermittent delays during execution of the similar failed software test;
- and
- collecting pass/fail data for the similar failed software test when altering computational environment parameters of the similar failed software test;
- and
- displaying, on a graphical user interface communicatively coupled to the IDE, a graphical illustration indicating the reliability index associated with the test failure and a predicted cause of the test failure based on the predicted cause of the similar failed software test.
Dependencies are inferred from the claim text.