Testing tool comprising an automated multidimensional traceability matrix for implementing and validating complex software systems

A method of selecting a subset of test cases from a body of test cases for testing the performance of a complex software systems, each complex software system comprising a plurality of software components, each test case being associated with at least one software component in the complex software systems and each test case being associated with a script providing a series of instructions to be executed by the complex software systems for the test case, the method comprising the steps of:

• a) displaying a graphical user interface to receive input information about dependencies and tributaries for the test cases and wherein the graphical user interface is adapted to display the dependencies and tributaries linked by two or more levels;
• b) storing the input information in a database associated with an automated multidimensional traceability matrix;
• c) receiving a change notice indicating that one or more of the software components have been changed;
• d) applying the automated multidimensional traceability matrix to determine which of the test cases are linked via previously defined linkages to the one or more of the software components that have been changed;
• e) displaying information using a graphical user interface that graphically displays which test cases are linked to the one or more of software components that have been changed and wherein the graphical user interface is adapted to display the linkages by two or more levels;
• f) selecting all or a subset of the linked test cases;
• g) executing the scripts associated with the selected linked test cases;
• and
• h) storing actual results for the executed scripts for later comparison with expected results for the executed scripts.

A method for user testing of updated software modules for complex software systems comprising a plurality of integrated software modules provided by one or more vendors, the method comprising the steps of:

• a) receiving a software update for a software module from a vendor;
• b) installing the software update on a server to provide an updated software module in the complex software system;
• c) applying an automated multidimensional traceability matrix to create a list of integrated software modules whose performance is linked to the updated software module, and then to create a list of the test cases associated with the integrated software modules whose performance is linked to the updated software module by using a graphical user interface that is adapted to graphically display linkages between the test cases and linkages between the integrated software modules by two or more levels;
• d) selecting a subset of the test cases list in step (c) and executing associated test scripts;
• and
• e) evaluating the results of the executed associated test scripts, wherein the results include a list of dependencies and tributaries for the integrated software modules.

A method for modifying a complex software system comprising a plurality of interrelated software modules, each module being associated with one or more interrelated test cases for testing the performance of the software modules, the method comprising the steps of:

• a) creating an automated multidimensional traceability matrix to electronically identify the relationships between the interrelated test cases, including dependency and tributary relationships, each test case in the automated multidimensional traceability matrix being linked to information about the associated interrelated software modules;
• b) creating a baseline of performance results for all or a subset of the interrelated test cases associated with the complex software system according to one or more testing scenarios comprising predetermined input data and one or more scripts directing the execution of a plurality of tests cases;
• c) creating a change in one or more of the interrelated software modules;
• d) selecting a subset of the test cases for testing of the complex software system, wherein the electing is done with the aid of an interactive analysis roadmap based on information from the automated multidimensional traceability matrix, the analysis roadmap using a graphical user interface that is adapted to display the selected subset of test cases and to display the relationships between the test cases by two or more levels and wherein the graphical user interface is adapted to display the interrelated software modules that may be affected by the change;
• e) executing all of or a subset of one or more test cases associated with the interrelated software modules that may be affected by the change to provide a set of post-change results;
• and
• f) comparing the post-change results with corresponding portions of the a baseline of performance.