Efficient software testing system

A method comprising:

• identifying, by a discrimination testing system executing on a processing system, a plurality of input characteristic subsets for a system under test based on an input schema;
• generating, by the discrimination testing system, a plurality of discrimination test cases comprising a combination of inputs for the system under test based on the input characteristic subsets;
• performing, by the discrimination testing system, a pruning operation to reduce a number of the discrimination test cases based on identifying a superset of input characteristics that includes at least one of the input characteristic subsets having a discrimination score above a threshold value;
• determining, by the discrimination testing system, a plurality of discrimination scores based on applying one or more of the discrimination test cases remaining after the pruning operation to the system under test and observing an output;
• and
• outputting, by the discrimination testing system, a measurement of discrimination of the system under test based on the discrimination scores.

A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by one or more processors to cause the one or more processors to perform:

• identifying a plurality of input characteristic subsets for a system under test based on an input schema;
• generating a plurality of discrimination test cases comprising a combination of inputs for the system under test based on the input characteristic subsets;
• performing a pruning operation to reduce a number of the discrimination test cases based on identifying a superset of input characteristics that includes at least one of the input characteristic subsets having a discrimination score above a threshold value;
• determining a plurality of discrimination scores based on applying one or more of the discrimination test cases remaining after the pruning operation to the system under test and observing an output;
• and
• outputting a measurement of discrimination of the system under test based on the discrimination scores.