System and method for predicting system failure and time-to-failure based on attribution scores of log data

A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations for managing data processing systems based on indications of a failure, the operations comprising:

• obtaining new log data for a data processing system of the data processing systems, the new log data comprising log lines that indicate activity of the data processing system during a period of time;
• ingesting the new log data into a trained inference model to obtain an inference, the trained inference model being based on training data, the training data comprising relationships between portions of log lines of historical log files and times-to-failures corresponding to historical failures of the data processing systems, and the training data being based on attribution scores for each log line of the portions of the log lines, and the inference indicating:
• a failure type for the data processing system, and
• a time-to-failure for the data processing system;
• and
• performing, based on the inference, an action set to reduce an impact of the failure.

A data processing system, comprising:

• a processor;
• and
• a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations for managing data processing systems based on indications of a failure, the operations comprising:
• obtaining new log data for a data processing system of the data processing systems, the new log data comprising log lines that indicate activity of the data processing system during a period of time,
• ingesting the new log data into a trained inference model to obtain an inference, the trained inference model being based on training data, the training data comprising relationships between portions of log lines of historical log files and times-to-failures corresponding to historical failures of the data processing systems, and the training data being based on attribution scores for each log line of the portions of the log lines, and the inference indicating:
• a failure type for the data processing system;
• and
• a time-to-failure for the data processing system, and
• performing, based on the inference, an action set to reduce an impact of the failure.