Configurable system wide tests
AssigneeMicrosoft Technology Licensing, LLC
InventorsConal McGarvey, Jakob F. Lichtenberg, Andrew D. Mikesell, Remy L. De Weduwe
Life of this patent
Estimating the term…
Abstract
Systems and methods to conduct data-driven, system wide tests are disclosed. Instructions for testing an operating system are associated with one or more modules associated with the computing system. When a failed test is identified, a second set of instructions that accounts for the failed test is generated and executed, in order to efficiently identify and target specific issues. Results from these fully configurable testing methods can be communicated and utilized in further applications.
Claims20
A system comprising:
- at least one processor;
- and
- at least one memory having stored thereon computer executable instructions that, when executed by the at least one processor, cause the system to:
- receive a first set of instructions comprising information indicative of a first test of one or more modules;
- cause execution the first test of the one or more modules;
- receive information identifying a test condition associated with execution of the first test, the test condition associated with a test failure that interrupts execution of the first test or requires intervention before continuing execution of the first test;
- in response to the information, generate a second set of instructions based on the identified test condition, the second set of instructions indicative of a second test that is determined based at least in part on the identified test condition and modified to bypass the test condition that is associated with the test failure;
- and
- cause execution of the second test without resolution of the identified test condition.
A method of performing integration testing of a computing system, the method comprising:
- receiving, by a computing device, a first set of instructions defining a first plurality of tests, the first plurality of tests associated with testing a plurality of modules of a computer operating system using a test configuration;
- executing the first plurality of tests based on the first set of instructions;
- identifying, by the computing device, a test condition associated with executing a first test of the first plurality of tests, the test condition associated with a module of the plurality of modules and associated with a test failure that prevents continued execution of the first test;
- generating, by the computing device, a second set of instructions based at least in part on the first set of instructions, the second set of instructions defining a second plurality of tests associated with the plurality of modules and modified to bypass the test condition that is associated with the test failure;
- and
- executing the second plurality of tests based on the second set of instructions without altering the test configuration.
A computer-readable storage medium comprising computer-readable instructions that, when executed by a computing device comprising a processor and memory, cause the computing device to perform operations comprising:
- receiving a first set of instructions defining a first plurality of tests, the first plurality of tests associated with testing a plurality of modules of a computer system in accordance with a test configuration;
- executing the first plurality of tests based on the first set of instructions;
- identifying a test condition associated with executing a first test of the first plurality of tests, the test condition associated with the plurality of modules and associated with a failure of the test condition;
- generating a second set of instructions based at least in part on the first set of instructions, the second set of instructions defining a second plurality of tests associated with the plurality of modules and modified to bypass the failed test condition;
- and
- executing the second plurality of tests based on the second set of instructions without resolving the test condition and without altering the test configuration.
Dependencies are inferred from the claim text.