Test selection based on an n-wise combinations coverage
AssigneeInternational Business Machines Corporation
InventorsDale E. Blue, Rachel Tzoref-Brill
Life of this patent
Estimating the term…
Abstract
Based on a functional coverage by a test suite, a functional coverage model of a System Under Test (SUT) may be defined to represent all covered combinations of functional attributes. Based on an n-wise combination criteria, a subset of the possible combinations of values may be determined A subset of the test suite may be selected such that the selected subset is operative to cover the subset of the determined possible combinations of values. The disclosed subject matter may be used to reduce a size of the test suite while preserving the n-wise combinations coverage of the original test suite.
Claims20
A computer-implemented method, the method performed by a computerized device, the method comprising:
- defining a functional coverage model of a System Under Test (SUT) based on a functional coverage by a test suite, wherein the test suite comprising a plurality of tests, wherein the functional coverage model comprises attributes, each having a set of possible values, wherein the functional coverage model defines possible combinations of values of the attributes as covered by the test suite;
- determining a subset of the possible combinations of values, wherein the subset is characterized in covering substantially all n-wise combinations of the possible combinations;
- and
- selecting a subset of the plurality of tests, wherein the selected subset of plurality of tests is operative to cover the subset of the determined possible combinations of values;
- whereby a reduction in a size of the test suite is achieved while preserving the n-wise combinations coverage.
A computerized apparatus having a processor, the apparatus comprising:
- a functional coverage model definer, wherein said functional coverage model definer is configured to define a functional coverage model of a System Under Test (SUT) based on functional coverage by a test suite, wherein the test suite comprises a plurality of tests, wherein the functional coverage model comprises attributes, each having a set of possible values, wherein the functional coverage model defines possible combinations of values of the attributes as covered by the test suite;
- a subset combinations determinator operative to determine a subset of the possible combinations of values, wherein the subset is characterized in covering substantially all n-wise combinations of the possible combinations;
- and
- a test selector operative to select a subset of the plurality of tests, wherein the selected subset of plurality of tests is operative to cover the subset determined by said subset combinations determinator.
A computer program product, the product comprising:
- a computer readable medium;
- a first program instruction for defining a functional coverage model of a System Under Test (SUT) based on a functional coverage by a test suite, wherein the test suite comprising a plurality of tests, wherein the functional coverage model comprises attributes, each having a set of possible values, wherein the functional coverage model defines possible combinations of values of the attributes as covered by the test suite;
- a second program instruction for determining a subset of the possible combinations of values, wherein the subset is characterized in covering substantially all n-wise combinations of the possible combinations;
- a third program instruction for selecting a subset of the plurality of tests, wherein the selected subset of plurality of tests is operative to cover the subset of the determined possible combinations of values;
- whereby performing by a computer of said first, second, and third, program instructions is operative to achieve a reduction in a size of the test suite while preserving the n-wise combinations coverage;
- and
- wherein said first, second, and third, program instructions are stored on said computer readable medium.
Dependencies are inferred from the claim text.