Automatic restarting and reconfiguration of physics-based models in event of model failure

A simulation model recovery computer program product, the computer program product comprising a computer-readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to perform:

• during an operation of a model, periodically writing a solution space of the model to a checkpoint restart file;
• during an operation of the model, periodically writing diagnostic information on model progression to a log file;
• detecting a failure of the model;
• based on the log file of the model, determining a time of the failure;
• based on the model outputs and restart files, determining a period of a numerical instability preceding the failure;
• selecting a checkpoint of the model preceding the period of the numerical instability;
• based on the numerical instability and diagnostic information in log files, modifying a configuration of the model;
• and
• restarting the model based on the selected checkpoint and the modified configuration.

A simulation model recovery system, the system comprising:

• a processor;
• and
• a memory, the memory storing instructions to cause the processor to perform:
• during an operation of a model, periodically writing a solution space of the model to a checkpoint restart file;
• during an operation of the model, periodically writing diagnostic information on model progression to a log file;
• and
• based on the log file of the model, determining a time of the failure,
• wherein the log file is analyzed to extract from the log file information related to a cause of the model crash using a model exit characterization component that collates the information on the failure, and
• wherein a lexical matching is conducted via the model exit characterization component to match an exit code from the log file information and a description of the model crash.