Back to results
US 10,592,389 B2Granted
Integrating synthetic performance measurements with continuous delivery pipelines
AssigneeInternational Business Machines Corporation
InventorsLaquicia S. Barbee, Erica M. Brown, Martin J. C. Presler-Marshall, Shikha Srivastava
Life of this patent
Estimating the term…
Abstract
Continuous development pipeline systems and in-field synthetic performance test systems are interlocked to provide for automated control of promotion of program code elements within the development pipeline and in the deployment environment using relative comparative performance values rather than absolute performance thresholds, in order to better accommodate “last mile” variations in client device conditions.
Claims18
A method comprising:
- selecting, by a computer, a synthetic performance test to measure a first set of performance attributes of a web-based service to a network-connected client device;
- performing, by a computer, a first instantiation of the selected test within a continuous development pipeline, under a set of baseline conditions, to determine a set of baseline set of test result values for the first set of performance attributes;
- performing, by a computer, a second instantiation of the selected test under a set of conditions outside of the continuous development pipeline, to determine an additional set of test result values for the first set of performance attributes;
- determining, by a computer, a relative difference between the baseline set of test result values to the additional set of test result values;
- detecting, by a computer, that the determined relative difference exceeds at least one relative threshold, wherein the detecting is not reliant upon an absolute threshold;
- and
- responsive to the detecting, performing, by a computer, a machine logic rule to meet a quality of service objective associated with the web-based service, wherein the executed rule comprises at least one or more rules selected from the group consisting of automatically reconfiguring an enterprise computing system associated with the web-based service outside the continuous development pipeline, and controlling advancement of a program code element within the continuous development pipeline.
4 more elements
A computer program product comprising:
- a tangible, computer-readable memory device;
- and
- program instructions encoded by the tangible, computer-readable memory device for causing a processor to, when executed, perform steps of:
- selecting a synthetic performance test to measure a first set of performance attributes of a web-based service to a network-connected client device;
- performing a first instantiation of the selected test within a continuous development pipeline, under a set of baseline conditions, to determine a set of baseline set of test result values for the first set of performance attributes;
- performing a second instantiation of the selected test under a set of conditions outside of the continuous development pipeline, to determine an additional set of test result values for the first set of performance attributes;
- determining a relative difference between the baseline set of test result values to the additional set of test result values;
- detecting that the determined relative difference exceeds at least one relative threshold, wherein the detecting is not reliant upon an absolute threshold;
- and
- responsive to the detecting, performing a machine logic rule to meet a quality of service objective associated with the web-based service, wherein the executed rule comprises at least one or more rules selected from the group consisting of automatically reconfiguring an enterprise computing system associated with the web-based service outside the continuous development pipeline, and controlling advancement of a program code element within the continuous development pipeline.
7 more elements
A system comprising:
- a computer processor;
- a tangible, computer-readable memory device;
- and
- program instructions encoded by the tangible, computer-readable memory device for causing the processor to, when executed, perform steps of:
- selecting a synthetic performance test to measure a first set of performance attributes of a web-based service to a network-connected client device;
- performing a first instantiation of the selected test within a continuous development pipeline, under a set of baseline conditions, to determine a set of baseline set of test result values for the first set of performance attributes;
- performing a second instantiation of the selected test under a set of conditions outside of the continuous development pipeline, to determine an additional set of test result values for the first set of performance attributes;
- determining a relative difference between the baseline set of test result values to the additional set of test result values;
- detecting that the determined relative difference exceeds at least one relative threshold, wherein the detecting is not reliant upon an absolute threshold;
- and
- responsive to the detecting, performing a machine logic rule to meet a quality of service objective associated with the web-based service, wherein the executed rule comprises at least one or more rules selected from the group consisting of automatically reconfiguring an enterprise computing system associated with the web-based service outside the continuous development pipeline, and controlling advancement of a program code element within the continuous development pipeline.
8 more elements
Dependencies are inferred from the claim text.