System and method for continuous failure prediction and remediation within a computational environment using independent execution units

A method comprising:

• forming, from a computer system comprising system resources configured to execute a workload, a plurality of units of system resources;
• dividing the workload into a plurality of workload units, each workload unit of the plurality of workload assigned to a unit of system resources of the plurality of units of system resources;
• for each workload unit, executing the workload unit on the assigned unit of system resources;
• measuring first values for a set of performance metrics associated with the computer system, the set of performance metrics comprising, for each unit of system resources of the plurality of units of system resources, one or more metrics associated with a performance of the unit of system resources and one or more metrics associated with a performance of the workload unit executing on the unit of system resources;
• determining, based on the first values for the set of performance metrics, that a first probability that a first failure associated with the computer system will occur within a first future time is greater than a set threshold;
• and
• in response to determining that the first probability is greater than the set threshold:
• determining, based on the first values for the set of performance metrics, that the first failure is a known failure associated with the computer system;
• identifying a remediation script associated with the known failure from a set of remediation scripts stored within a memory, the remediation script configured, when executed, to remediate the known failure;
• and
• executing the identified remediation script;
• measuring second values for the set of parameters associated with the computer system, the second values measured at a different time than the first values for the set of performance metrics;
• determining, based on the second values for the set of parameters, that a second probability that a second failure associated with the computer system will occur within a second future time is greater than the given threshold;
• and
• in response to determining that the second probability is greater than the given threshold:
• determining, based on the second values for the set of parameters, that the second failure is an unknown failure;
• and
• in response to determining that the second failure is the unknown failure, transmitting a message to a system administrator, the message comprising the second values for the set of parameters;
• in response to transmitting the message to the system administrator:
• receiving a new remediation script associated with a new known failure, the new known failure corresponding to the unknown failure;
• and
• storing the new remediation script in the memory, the new remediation script associated with the new known failure.

A system comprising:

• a computer system configured to execute a workload, the workload divided into a plurality of workload units, the computer system comprising a plurality of units of system resources, each unit of system resources of the plurality of units of system resources configured to execute a workload unit of the plurality of workload units;
• a memory configured to store a set of remediation scripts, each remediation script associated with a known failure associated with the computer system and configured, when executed, to remediate the known failure;
• and
• a hardware processor communicatively coupled to the memory, the hardware processor configured to:
• measure first values for a set of performance metrics associated with the computer system, the set of performance metrics comprising, for each unit of system resources of the plurality of units of system resources, one or more metrics associated with a performance of the unit of system resources and one or more metrics associated with a performance of the workload unit executing on the unit of system resources;
• determine, based on the first values for the set of performance metrics, that a first probability that a first failure associated with the computer system will occur within a first future time is greater than a set threshold;
• and
• in response to determining that the first probability is greater than the set threshold:
• determine, based on the first values for the set of metrics, that the first failure is an unknown failure;
• and
• in response to determining that the first failure is the unknown failure, transmit a message to a system administrator, the message comprising the first values for the set of parameters;
• in response to transmitting the message to the system administrator, the hardware processor is further configured to:
• receive a new remediation script associated with a new known failure, the new known failure corresponding to the unknown failure;
• store the new remediation script in the memory, the new remediation script associated with the new known failure.