Instruction count based compiler performance regression testing
AssigneeInternational Business Machines Corporation
InventorGaby Baghdadi
Life of this patent
Estimating the term…
Abstract
Techniques for instruction count based compiler performance regression testing are described herein. An aspect includes identifying a subset of a plurality of test cases that are regression suspects for a current build of a compiler, wherein the identifying of a test case of the plurality of test cases as a regression suspect is performed based on an instruction count associated with compiling or running of the test case using the current build of the compiler and a previous build of the compiler. Another aspect includes processing the subset of the plurality of test cases to identify any test cases associated with confirmed regressions.
Claims17
A computer-implemented method comprising:
- identifying, by a processor, a subset of a plurality of test cases, wherein the subset comprises test cases of the plurality of test cases that are identified as regression suspects for a current build of a compiler, and wherein identifying a test case of the plurality of test cases as belonging to the subset comprises:
- determining a first instruction count associated with compiling or running of the test case based on the current build of the compiler;
- and
- determining a second instruction count associated with compiling or running of the test case based on a previous build of the compiler;
- determining a difference between the second instruction count and the first instruction count;
- and
- adding the test case to the subset based on the difference between the second instruction count and the first instruction count being above a threshold;
- and
- processing the subset of the plurality of test cases to identify any test cases associated with confirmed regressions.
A system comprising:
- a memory having computer readable instructions;
- and
- one or more processors for executing the computer readable instructions, the computer readable instructions controlling the one or more processors to perform operations comprising:
- identifying a subset of a plurality of test cases, wherein the subset comprises test cases of the plurality of test cases that are identified as regression suspects for a current build of a compiler, and wherein identifying a test case of the plurality of test cases as belonging to the subset comprises:
- determining a first instruction count associated with compiling or running of the test case based on the current build of the compiler;
- and
- determining a second instruction count associated with compiling or running of the test case based on a previous build of the compiler;
- determining a difference between the second instruction count and the first instruction count;
- and
- adding the test case to the subset based on the difference between the second instruction count and the first instruction count being above a threshold;
- and
- processing the subset of the plurality of test cases to identify any test cases associated with confirmed regressions.
A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform operations comprising:
- identifying a subset of a plurality of test cases, wherein the subset comprises test cases of the plurality of test cases that are identified as regression suspects for a current build of a compiler, and wherein identifying a test case of the plurality of test cases as belonging to the subset comprises:
- determining a first instruction count associated with compiling or running of the test case based on the current build of the compiler;
- and
- determining a second instruction count associated with compiling or running of the test case based on a previous build of the compiler;
- determining a difference between the second instruction count and the first instruction count;
- and
- adding the test case to the subset based on the difference between the second instruction count and the first instruction count being above a threshold;
- and
- processing the subset of the plurality of test cases to identify any test cases associated with confirmed regressions.
Dependencies are inferred from the claim text.