Automated testing system and operating method thereof

An operating method of a system comprising:

• providing at least a system under test (SUT) having collection of flash storages including hardware of array of flash storages, collection of partitions including logical volumes, a kernel subsystem including operating system, and an application layer including services, applications, systems, or a combination thereof;
• driving tests by test drivers, wherein the tests are configured for testing the SUT;
• generating test data sets corresponding to the test drivers by test fixtures;
• tracking test results of test cases created in accordance with the test drivers and the test data sets by observers, wherein the test results include metrics;
• and
• storing historical data of the test cases in archives.

A testing system comprising:

• at least a system under test (SUT) having collection of flash storages including hardware of array of flash storages, collection of partitions including logical volumes, a kernel subsystem including operating system, and an application layer including services, applications, systems, or a combination thereof;
• test drivers configured to drive tests, wherein the tests are configured for testing the SUT;
• test fixtures configured to generate test data sets corresponding to the test drivers;
• observers configured to track test results of test cases created in accordance with the test drivers and the test data sets, wherein the test results include metrics;
• and
• archives configured to store historical data of the test cases.