Determining a test confidence metric for a testing application
AssigneeOracle International Corporation
InventorsMayank Agarwal, Jagannadha Prasad Srinivas Vadlamani, Wendy Mui
Life of this patent
Estimating the term…
Abstract
Techniques for calculating a test confidence metric (TCM) are disclosed. Calculating the TCM involves obtaining test results of a testing application. Calculating the TCM is based on confidence scores corresponding respectively to the test results. Calculate a confidence score for a particular test result involves identifying a failure reason for the test result, determining a weight corresponding to the failure reason, and calculating the confidence score based on the weight.
Claims20
A non-transitory computer readable medium comprising instructions which, when executed by one or more hardware processors, cause performance of operations comprising:
- obtaining a first plurality of test results of a first testing application;
- and
- calculating a first test confidence metric for the first testing application based on a first plurality of confidence scores corresponding respectively to the first plurality of test results, wherein calculating a first confidence score in the first plurality of confidence scores comprises:
- (a) identifying a first failure reason for a first test result in the first plurality of test results,
- (b) determining a first weight corresponding to the first failure reason, and
- (c) calculating the first confidence score based on the first weight.
A system comprising:
- one or more hardware processors;
- and
- one or more one or more non-transitory computer-readable media storing instructions, which when executed by the one or more hardware processors, cause execution of operations comprising:
- obtaining a first plurality of test results of a first testing application;
- and
- calculating a first test confidence metric for the first testing application based on a first plurality of confidence scores corresponding respectively to the first plurality of test results, wherein calculating a first confidence score in the first plurality of confidence scores comprises:
- (a) identifying a first failure reason for a first test result in the first plurality of test results,
- (b) determining a first weight corresponding to the first failure reason, and
- (c) calculating the first confidence score based on the first weight.
A method comprising:
- obtaining a first plurality of test results of a first testing application;
- and
- calculating a first test confidence metric for the first testing application based on a first plurality of confidence scores corresponding respectively to the first plurality of test results, wherein calculating a first confidence score in the first plurality of confidence scores comprises:
- (a) identifying a first failure reason for a first test result in the first plurality of test results,
- (b) determining a first weight corresponding to the first failure reason, and
- (c) calculating the first confidence score based on the first weight,
- wherein the method is performed by at least one device comprising a hardware processor.
Dependencies are inferred from the claim text.