Application regression detection in computing systems

A computing device in a distributed computing system having multiple hosts interconnected by a computer network, the individual hosts executing one or more user applications to provide cloud services to tenants, the computing device comprising:

• a processor;
• and
• a memory operatively coupled to the processor, the memory containing instructions executable by the processor to cause the computing device to:
• perform an analysis of telemetry records received via the computer network from one or more hosts of the distributed computing system, at least some of the telemetry records are exception records individually indicating an operation by a user application has failed during execution on one or more of the hosts;
• based on the analysis of the telemetry records, derive an error percentage related to the operation based on a number of occurrences in which the operation has failed and a total number of occurrences in which the operation is executed by the user application, thereby compensating for a workload of the user application;
• determine whether application regression has occurred in the user application based on the derived error percentage compensated for the workload of the user application;
• and
• in response to determining that application regression has occurred in the user application, transmit, via the computer network, a regression notification to a tenant corresponding to the user application, the regression notification indicating that application regression has occurred in the user application notwithstanding the workload of the user application.

A method for detecting application regression in a distributed computing system having multiple hosts interconnected by a computer network, the individual hosts executing one or more user applications to provide cloud services to tenants, the method comprising:

• receiving, via the computer network, data representing telemetry records from one or more hosts of the distributed computing system, at least some of the telemetry records are exception records individually indicating an operation by a user application has failed during execution;
• determining a failure rate of executing the operation by the user application in the distributed computing system while compensating for a workload of the user application in the distributed computing system;
• performing a comparison of the determined failure rate with a threshold;
• and
• based on the performed comparison of the determined failure rate with the threshold, transmitting a regression notification to a corresponding tenant, the regression notification indicating that application regression has occurred in the user application notwithstanding the workload of the user application in the distributed computing system.