Optimized identification of performance regression
AssigneeSnowflake Inc.
InventorsAllison Lee, Shrainik Jain, Qiuye Jin, Stratis Viglas, Jiaqi Yan
Life of this patent
Estimating the term…
Abstract
A baseline run of a workload and a target run of the workload are compared to identify whether there is a performance regression in the target run, wherein the target run implements a feature that is not implemented in the baseline run. In response to identifying the performance regression, the target run is executed to identify whether the performance regression still exists. The performance regression is flagged as a false positive in response to identifying that the performance regression no longer exists when the target run is executed.
Claims30
A system for testing a feature on a database, the system comprising:
- a processor to:
- repeatedly execute a test run of a workload using resources of a cloud environment at one or more execution rates to identify whether there is a performance difference in the test run;
- in response to identifying the performance difference, increase the resources of the cloud environment;
- re-execute the test run using the increased resources of the cloud environment and at a slower speed than the one or more execution rates to identify whether the performance difference still exists;
- and
- determine that the performance difference is attributed to variations in the cloud environment in response to identifying that the performance difference no longer exists.
A method of testing a feature on a database, the method comprising:
- repeatedly executing a test run of a workload using resources of a cloud environment at one or more execution rates to identify whether there is a performance difference in the test run;
- in response to identifying the performance difference, increasing the resources of the cloud environment;
- re-executing the test run using the increased resources of the cloud environment and at a slower speed than the one or more execution rates to identify whether the performance difference still exits;
- and
- determine that the performance difference is attributed to variations in the cloud environment in response to identifying that the performance difference no longer exists.
A non-transitory computer readable storage media, programmable to execute instructions that, when executed, cause a processor to:
- repeatedly execute a test run of a workload using resources of a cloud environment at one or more execution rates to identify whether there is a performance difference in the test run;
- in response to identifying the performance difference, increase the resources of the cloud environment;
- re-execute the test run using the increased resources of the cloud environment and at a slower speed than the one or more execution rates to identify whether the performance difference still exists;
- and
- determine that the performance difference is attributed to variations in the cloud environment in response to identifying that the performance difference no longer exists.
Dependencies are inferred from the claim text.