System for testing operation of software

A computer system comprising a processor, a memory coupled to the processor, and a computer readable storage device coupled to the processor, said storage device containing program code configured to be executed by the processor via the memory to implement a method for processing test results from testing operation of software, said method comprising:

• receiving, by said processor, a test result for each test case of multiple test cases for a test performed for each release of multiple releases of the software, said test result for each test for each release being a first character string denoting a pass status for the test, a second character string denoting a fail status for the test, or a third character string denoting an unperformed status for the test indicating that the test has not been performed;
• ascertaining, by said processor, a group to which each test belongs, said ascertaining comprising determining a group identifier of the group to which each test belongs, said group identifier for each test case being a group character string determined from the test results of the tests performed for all releases of the multiple releases for said each test case, said ascertained groups consisting of multiple groups, each group of at least one group of the multiple groups comprising at least two test cases of the multiple test cases;
• calculating, by said processor, a test result stability index for each test case as being proportional to a total number of consecutive releases that include and are prior to the last release of the multiple releases of the software such that the test result for each release of the consecutive releases is the first character string denoting the pass status;
• calculating, by said processor, a module stability index for each test case as being a summation over a product of a weight at each release and a binary stability indicator of 0 at each release for which the test result is changed from the test result at the immediately prior release and 1 at every other release;
• and
• for each test case, storing, by said processor, the group identifier, the test result stability index, and the module stability index in a hardware storage unit of the computer system.