Determining test application effectiveness

A memory resource storing instructions that when executed cause a processing resource to implement a system to evaluate effectiveness of a test application, the instructions comprising:

• a display module, to provide a graphic user interface and cause a display of a documentation test quality factor, a product-general test quality factor, a product-specific test quality factor, and a defect severity factor to be considered by a user in evaluating a test application via the interface, the test application to test a software program;
• an evaluation data module, to receive via the interface, as test application evaluation data for the application, user-assigned ratings for the documentation test quality factor, the product-general test quality factor, the product-specific test quality factor, and the defect severity factor,
• wherein the documentation test quality factor includes at least one of a stated goal for the test application, an explanatory title, stated test steps, and stated expected test results or behaviors, the product-general test quality factor includes at least one of an installation task, an uninstallation task, a use case task, an internationalization, and a localization task, the product-specific test quality factor includes at least one of a code specifying at least one of a named document, a named program function, a named program class, a named program library, and a named program object, and defect severity factor includes an impact to a user or stakeholder if the software program fails upon execution of the test application;
• and
• a rating module, to determine, in consideration of the ratings, an overall test effectiveness rating for the test application and cause a display of the ratings via the interface.

A test application evaluation method, comprising:

• providing a graphic user interface and causing a display via the interface of a plurality of factors to be considered by a user in evaluating a subject test application for testing a software program;
• receiving via the interface evaluation data for the subject test application, the evaluation data including user-assigned ratings for a documentation test quality factor, a product-general test quality factor, a product-specific test quality factor, and a defect seventy factor;
• determining, based upon the ratings, and providing via the interface an overall test effectiveness rating for the subject test application;
• determining an improvement priority rating based upon at least two of the user-assigned documentation test quality factor rating, the user-assigned product-general test quality factor rating, the user-assigned product-specific test quality factor rating, the user-assigned defect severity factor rating, and the determined overall test effectiveness rating, and providing a recommendation or alert responsive to determining the improvement priority rating is above a threshold rating;
• accessing data indicative of evaluation of a plurality of test applications for testing the software program, the plurality including the subject test application;
• and
• providing a recommendation or alert responsive to determining, that a product-specific test quality factor is not directly tested by one of the plurality of test applications.