Web-based application platform applying lean production methods to system delivery testing

A non-transitory computer-readable storage medium coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations for testing of delivered software systems, the operations comprising:

• receiving, by a data drive test (DDT) platform executing on a first server system, one or more computer-readable files comprising test data, the test data comprising data that is specific to a first customer in a set of customers to execute at least one transaction during testing of a software system that is configurable for each customer in the set of customers and at least partially hosted by a vendor back-end system executing on a second server system;
• providing, by the DDT platform, one or more test scenarios for execution by the software system on the vendor back-end system, the one or more test scenarios comprising a set of activities to conduct transactions by the software system using at least a portion of the test data the one or more test scenarios being specific to the first customer;
• scheduling, by a scheduler of the DDT platform, execution of the one or more test scenarios using a test harness of the DDT platform, the one or more test scenarios being executed by the software system as configured for the first customer, the scheduler communicating with the test harness to trigger execution of the one or more test scenarios, the test harness providing activity-specific calls to the second server system for execution of each activity in the set of activities for a respective test scenario by the software system;
• receiving, by the test harness of the DDT platform, test results from the vendor back-end system;
• and
• comparing, by the test harness the DDT platform, the test results to expected results to provide a comparison as output.

A system, comprising:

• one or more processors;
• and
• a computer-readable storage device coupled to the one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations for testing of delivered software systems, the operations comprising:
• receiving, by a data drive test (DDT) platform executing on a first server system, one or more computer-readable files comprising test data, the test data comprising data that is specific to a first customer in a set of customers to execute at least one transaction during testing of a software system that is configurable for each customer in the set of customers and at least partially hosted by a vendor back-end system executing on a second server system;
• providing, by the DDT platform, one or more test scenarios for execution by the software system on the vendor back-end system, the one or more test scenarios comprising a set of activities to conduct transactions by the software system using at least a portion of the test data, the one or more test scenarios being specific to the first customer;
• scheduling, by a scheduler of the DDT platform, execution of the one or more test scenarios using a test harness of the DDT platform, the one or more test scenarios being executed by the software system as configured for the first customer, the scheduler communicating with the test harness to trigger execution of the one or more test scenarios, the test harness providing activity-specific calls to the second server system for execution of each activity in the set of activities for a respective test scenario by the software system;
• receiving, by the test harness of the DDT platform, test results from the vendor back-end system;
• and
• comparing, by the test harness the DDT platform, the test results to expected results to provide a comparison as output.