Performance regression manager for large scale systems
AssigneeInternational Business Machines Corporation
InventorDaniel A. Faraj
Life of this patent
Estimating the term…
Abstract
System and computer program product to perform an operation comprising generating, based on a first output generated by a first execution instance of a command, a first output file specifying a value of at least one performance metric, wherein the first output file is formatted according to a predefined format, comparing the value of the at least one performance metric in the first output file to a value of the performance metric in a second output file, the second output file having been generated based on a second output generated by a second execution instance of the command, and outputting for display an indication of a result of the comparison of the value of the at least one performance metric of the first output file to the value of the at least one performance metric of the second output file.
Claims13
A system, comprising:
- one or more computer processors;
- and
- a memory containing a program, which, when executed by the one or more computer processors, performs an operation, the operation comprising:
- receiving, by a user-defined plugin specifying a plurality of performance metrics and a first output file format, a first output generated by a first execution instance of a command;
- generating, by the user-defined plugin applied to the first output, a first output file specifying a respective value for each of the plurality of performance metrics, wherein the values in the first output file specify a respective level of use of a respective system resource, of a plurality of system resources, experienced by executing the first execution instance of the command on the system;
- comparing, by the user-defined plugin based on a respective comparison rule, of a plurality of comparison rules, each value in the first output file to:
- (i) a respective value for each of the plurality of performance metrics in a second output file, and (ii) a respective value for each of the plurality of performance metrics in a third output file, the second output file having been generated based on a second output generated by a second execution instance of the command, the third output file having been generated based on a third output generated by a third execution instance of the command, wherein the values of the plurality of performance metrics of the first, second, and third output files are formatted according to the first output file format to facilitate comparison across execution instances of the command;
- and
- outputting an indication of a result of the comparisons.
A computer program product, comprising:
- a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by a processor to perform an operation comprising:
- receiving, by a user-defined plugin specifying a plurality of performance metrics and a first output file format, a first output generated by a first execution instance of a command;
- generating, by the user-defined plugin applied to the first output, a first output file specifying a respective value for each of the plurality of performance metrics, wherein the values in the first output file specify a respective level of use of a respective system resource, of a plurality of system resources, experienced by executing the first execution instance of the command on the system;
- comparing, by the user-defined plugin based on a respective comparison rule, of a plurality of comparison rules, each value in the first output file to:
- (i) a respective value for each of the plurality of performance metrics in a second output file, and (ii) a respective value for each of the plurality of performance metrics in a third output file, the second output file having been generated based on a second output generated by a second execution instance of the command, the third output file having been generated based on a third output generated by a third execution instance of the command, wherein the values of the plurality of performance metrics of the first, second, and third output files are formatted according to the first output file format to facilitate comparison across execution instances of the command;
- and
- outputting an indication of a result of the comparisons.
Dependencies are inferred from the claim text.