Test manager for integrated test environments

A computer-implemented system for conducting a test for testing units under test, the system comprising:

• a display;
• and
• a processor configured to
• provide a user interface on the display for users to edit the test to include a plurality of test steps for testing the units under test, the test including a sequence of at least a first test step and a second test step, the second step being of a different type than the first test step, the first test step and the second test step being of types selected from a group consisting of a test step for testing a textual program, a test step for testing a graphical program, a test step for testing a function provided in a software tool and a test step for testing a hardware device;
• enable the user to edit one or more independent parameters, an independent parameter defining a dimension of a parametric space, the parametric space including a plurality of points;
• generate code for the test;
• and
• execute the code using defined values of the one or more independent parameters to generate output data from a number of executions of test, elements of the output data corresponding to the plurality of points of the parametric space of the one or more independent parameters, wherein execute the code comprising:
• use at least two independent parameters to execute the code, wherein at least one of the at least two used independent parameters has a plurality of defined values,
• determine the number of executions of the test by multiplying the defined values in each of the at least two used independent parameters;
• initialize a multidimensional parametric space for storing the output data generated from the number of executions of the test, dimensions of the multidimensional parametric space representing and corresponding to a product of the defined values in each of the at least two used independent parameters, and
• add the output data to the multidimensional parametric space.

A system for providing a test environment in a computational device, the system comprising:

• storage;
• and
• a processor configured to:
• provide a first user interface for users to edit a test to include a sequence of one or more test steps for testing units under test, each of the one or more test steps being of a type selected from a group consisting of a test step for testing a textual program, a test step for testing a graphical program, a test step for testing a function provided in a software tool and a test step for testing a hardware device;
• provide a second user interface for the users to edit one or more independent parameters, an independent parameter defining a dimension of a parametric space, the parametric space including a plurality of points;
• generate code for the test;
• automatically execute the code using defined values of the one or more independent parameters to produce output data from a number of executions of the test, elements of the output data corresponding to the plurality of points of the parametric space of the one or more independent parameters, wherein automatically execute comprises:
• use at least two independent parameters to execute the code, wherein at least one of the at least two used independent parameters has a plurality of defined values,
• determine the number of executions of the test by multiplying the defined values in each of the at least two used independent parameters;
• initialize a multidimensional parametric space for storing the output data generated from the number of executions of the test, dimensions of the multidimensional parametric space representing and corresponding to a product of the defined values in each of the at least two used independent parameters,
• add the output data to the multidimensional parametric space, and
• store the output data as a multidimensional dataset in the storage, elements of the multidimensional dataset corresponding to the plurality of points of the parametric space in the at least two used independent parameters.

A computer-readable storage medium holding computational device executable instructions for conducting a test for testing units under test, the medium comprising:

• instructions for enabling users to edit the test to include a sequence of one or more test steps for testing the units under test, each of the one or more test steps being of a type selected from a group consisting of a test step for testing a textual program, a test step for testing a graphical program, a test step for testing a function provided in a software tool and a test step for testing a hardware device;
• instructions for enabling the users to edit one or more independent parameters, an independent parameter defining a dimension of a parametric space, the parametric space including a plurality of points;
• instructions for generating code for the test;
• and
• instructions for automatically executing the code using defined values of the one or more independent parameters to generate output data from a number of executions of the test, elements of the output data corresponding to the plurality of points of the parametric space of the one or more independent parameters, wherein the instructions for automatically executing comprises:
• instructions for using at least two independent parameters to execute the code, wherein at least one of the at least two used independent parameters has a plurality of defined values,
• instructions for determining the number of executions of the test by multiplying the defined values in each of the at least two used independent parameters;
• instructions for initializing a multidimensional parametric space for storing the output data generated from the number of executions of the test, dimensions of the multidimensional parametric space representing and corresponding to a product of the defined values in each of the at least two used independents, and
• instruction for adding the output data to the multidimensional parametric space.