Software acceptance testing platform for a computer system carrying live network traffic in a telecommunication network

A method of testing software executing on a first computer system, comprising:

• receiving a command to run a test suite by a job manager application executing on a second computer system, wherein the command to run the test suite comprises an identity of the test suite;
• creating a test job by filling out a test template with configuration information by the job manager application;
• sending the test job to a dispatch application instance executing on a third computer system by the job manager application;
• receiving a query by the dispatch application instance from a testing application executing on the first computer system on which the software executes, wherein the query asks if the test job is pending;
• in response to receiving the query, sending a link to the test job by the dispatch application instance to the testing application;
• executing a plurality of test instructions associated with the test job by the testing application on the first computer system on which the software executes;
• capturing information about a container associated with the software by the testing application, wherein the information about the container comprises a memory allocation associated with the container, a memory consumed by the container, a central processing unit (CPU) utilization allocation, a CPU allocation consumed, and an internet protocol (IP) address assigned to the container;
• capturing test results of the execution of the plurality of test instructions by the testing application;
• sending the information about the container and the test results of the execution of the plurality of test instructions by the testing application to the dispatch application instance;
• sending the information about the container and the test results of the execution of the plurality of test instructions by the dispatch application instance to a test validation application executing on a fourth computer system;
• determining a test case score by the test validation application based on the information about the container, on the test results of the execution of the plurality of test instructions, and on a test scoring policy defined by the test ease suite, wherein the test scoring policy defines scoring based in part on a type of the container;
• providing the test case score by the test validation application to an action engine executing on a fifth computer system;
• and
• based on the test case score, taking action by the action engine in the first computer system on which the software executes.

A method of testing production software executing on a first computer system carrying live traffic in a telecommunication network, comprising:

• receiving a command to run a test suite by a job manager application executing on a second computer system, wherein the command to run the test suite comprises an identity of the test suite;
• retrieving a test template by the job manager application from a data store based on the identity of the test suite;
• identifying a dispatch application instance executing on a third computer system by the job manager application, wherein the dispatch application instance is associated with the first computer system on which the production software executes;
• creating a test job by filling out the test template with configuration information by the job manager application based on the first computer system on which the production software executes;
• sending the test job to the dispatch application instance by the job manager application;
• receiving a query by the dispatch application instance from a testing application executing on the first computer system on which the production software executes, wherein the query asks if the test job is pending;
• in response to receiving the query, sending a link to the test job by the dispatch application instance to the testing application;
• sending a request for a plurality of test instructions by the testing application to a command storage and authorization (CSA) application executing on a fourth computer system, wherein the request for the plurality of test instructions comprises the link to the test job and a secure signature associated with the testing application;
• validating the secure signature by the CSA application;
• validating by the CSA application that the testing application is qualified to execute the test job;
• sending the plurality of test instructions by the CSA application to the testing application;
• calculating a checksum value by the testing application over the plurality of test instructions;
• comparing the calculated checksum value by the testing application to a canonical checksum value defined for the plurality of test instructions;
• executing the plurality of test instructions by the testing application on the first computer system on which the production software executes;
• capturing information about a container associated with the production software;
• capturing test results of the execution of the plurality of test instructions by the testing application;
• sending the information about the container and the test results of the execution of the plurality of test instructions by the testing application to the dispatch application instance;
• sending the information about the container and the test results of the execution of the plurality of test instructions by the dispatch application instance to a test validation application executing on a fifth computer system;
• determining a test case score by the test validation application based on the information about the container, on the test results of the execution of the plurality of test instructions, and on a test scoring policy defined by the test suite;
• providing the test case score by the test validation application to an action engine executing on a sixth computer system;
• and
• based on the test case scores, taking action by the action engine in the first computer system on which the production software executes.