Determining relevant tests through continuous production-state analysis

An apparatus comprising:

• a communication interface that enables communication with a production computing environment, the production computing environment including one or more computing devices and associated software, one or more networking devices and associated software and one or more data storage devices and associated software;
• memory;
• one or more computer processors configured to execute instructions stored in the memory to perform operations including:
• obtaining configuration information describing a configuration of a production computing environment;
• obtaining testing information relating to a particular testing scenario to be performed for the production computing environment;
• monitoring operation of the production computing environment to obtain a history of operational states and a plurality of changes made to the production computing environment over time;
• obtaining operational and testing data collected over time for a plurality of other production computing environments that have undergone a plurality of testing scenarios and configuration changes that impact the plurality of testing scenarios;
• and
• determining one or more particular changes of the plurality of changes to the production computing environment that should be validated for the particular testing scenario.

One or more non-transitory computer readable storage media encoded with instructions that, when executed by one or more computer processors, cause the one or more computer processors to perform operations including:

• obtaining configuration information describing a configuration of a production computing environment, the production computing environment including one or more computing devices and associated software, one or more networking devices and associated software and one or more data storage devices and associated software;
• obtaining testing information relating to a particular testing scenario to be performed for the production computing environment;
• monitoring operation of the production computing environment to obtain a history of operational states and a plurality of changes made to the production computing environment over time;
• obtaining operational and testing data collected over time for a plurality of other production computing environments that have undergone a plurality of testing scenarios and configuration changes that impact the plurality of testing scenarios;
• and
• determining one or more particular changes of the plurality of changes to the production computing environment that should be validated for the particular testing scenario.