Code integration with time-variant test failure detection

A system comprising:

• a processor;
• and
• a non-transitory computer-readable storage medium containing instructions for execution by the processor for:
• identifying a first version of software code and a test protocol for testing the first version of the software code;
• running the test protocol on the first version of the software code a plurality of times at a first time;
• receiving first test results from running the test protocol on the first version of the software code;
• determining a first test result stability score based on the first test results;
• identifying that the first test result stability score does not meet a pass threshold of the test protocol;
• and
• in response to identifying that the first test result stability score does not meet the pass threshold:
• identifying a previous version of the software code created before the first time and of which the first version of the software code is a modification;
• running the test protocol on the previous version of the software code a plurality of times to determine second test results;
• determining a second test result stability score based on the second test results;
• and
• determining that the first version of the software code did not introduce a regression relative to the previous version of the software code based on the first test results, the second test results, the first test result stability score, and the second test result stability score.

One or more non-transitory computer-readable storage media containing instructions executable by one or more processors for:

• identifying a first version of software code and a test protocol for testing the first version of the software code;
• running the test protocol on the first version of the software code a plurality of times at a first time;
• receiving first test results from running the test protocol on the first version of the software code;
• determining a first test result stability score based on the first test results;
• identifying that the first test result stability score does not meet a pass threshold of the test protocol;
• and
• in response to identifying that the first test result stability score does not meet the pass threshold:
• identifying a previous version of software code created before the first time and of which the first version of the software code is a modification;
• running the test protocol on the previous version of the software code a plurality of times to determine second test results;
• determining a second test result stability score based on the second test results;
• and
• determining that the first version of the software code did not introduce a regression relative to the previous version of the software code based on the first test results, the second test results, the first test result stability score, and the second test result stability score.