Reverse testing strategies designed for black-box and exploratory testing

A system comprising:

• one or more processors;
• and
• one or more computer-readable memories coupled to the one or more processors and having instructions stored thereon that are executable by the one or more processors to perform operations comprising:
• obtaining initial test outputs from test case scenarios defined for a data processing application, wherein the test case scenarios are associated with a combination of values for parameters provided for user selection at a user interface of the data processing application, wherein a test output comprises an output data set provided based on a particular combination of values for the parameters at the user interface;
• providing instructions to a user to execute user-defined tests to obtain a particular test output from the test outputs, wherein the instructions are provided without providing instructions to the user for input values for parameters to be used for obtaining the particular test output, wherein the execution of the user-defined tests is performed at the data processing application when associated with a test data source;
• obtaining data from the executed user-defined tests at the data processing application, wherein the obtained data includes input data provided for processing at the data processing application as part of the user-defined tests and output data obtained based on the processing when invoking data from the test data source based on the user-defined tests;
• performing data analysis over the obtained data to evaluate quality of executions of services provided by the data processing application;
• and
• generating a quality status for the services provided by the data processing application, wherein the quality status is generated to include at least one more further test input for a test case scenario to be executed over the data processing application.

A non-transitory, computer-readable medium coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising

• obtaining initial test outputs from test case scenarios defined for a data processing application, wherein the test case scenarios are associated with a combination of values for parameters provided for user selection at a user interface of the data processing application, wherein a test output comprises an output data set provided based on a particular combination of values for the parameters at the user interface;
• providing instructions to a user to execute user-defined tests to obtain a particular test output from the test outputs, wherein the instructions are provided without providing instructions to the user for input values for parameters to be used for obtaining the particular test output, wherein the execution of the user-defined tests is performed at the data processing application when associated with a test data source;
• obtaining data from the executed user-defined tests at the data processing application, wherein the obtained data includes input data provided for processing at the data processing application as part of the user-defined tests and output data obtained based on the processing when invoking data from the test data source based on the user-defined tests;
• performing data analysis over the obtained data to evaluate quality of executions of services provided by the data processing application;
• and
• generating a quality status for the services provided by the data processing application, wherein the quality status is generated to include at least one more further test input for a test case scenario to be executed over the data processing application.