Method, electronic device, and computer program product for training failure analysis model

An electronic device, comprising:

• a processor;
• and
• a memory coupled to the processor, the memory having instructions stored therein, wherein the instructions, when executed by the processor, cause the electronic device to perform actions for training a failure analysis model, the failure analysis model being used to determine a failure cause of a storage system, the actions comprising:
• obtaining at least one set of log files including multiple preprocessed log files, the at least one set of log files including a marked failure cause of the storage system, and preprocessed log files in the multiple preprocessed log files including one or more potential failure causes of the storage system and scores associated with the potential failure causes;
• predicting a failure cause of the storage system according to the failure analysis model and based on the potential failure causes and the scores in the multiple preprocessed log files;
• and
• updating parameters of the failure analysis model based on a probability that the predicted failure cause is the marked failure cause;
• wherein each of at least a subset of preprocessed log files comprises a plurality of fields for respective ones of a failure type, a log file type, an identifier of a storage node of the storage system, and a score for the corresponding preprocessed log file;
• and
• wherein a failure feature is determined for use in the failure analysis model at least in part by aggregating the scores for multiple ones of the preprocessed log files based on one or more of the failure type, the storage node identifier and the log file type.

A computer program product that is tangibly stored on a non-transitory computer-readable storage medium and comprises machine-executable instructions, wherein the machine-executable instructions, when executed by a machine, cause the machine to perform a method for training a failure analysis model, the failure analysis model being used to determine a failure cause of a storage system, the method comprising:

• obtaining at least one set of log files including multiple preprocessed log files, the at least one set of log files including a marked failure cause of the storage system, and preprocessed log files in the multiple preprocessed log files including one or more potential failure causes of the storage system and scores associated with the potential failure causes;
• predicting a failure cause of the storage system according to the failure analysis model and based on the potential failure causes and the scores in the multiple preprocessed log files;
• and
• updating parameters of the failure analysis model based on a probability that the predicted failure cause is the marked failure cause;
• wherein each of at least a subset of preprocessed log files comprises a plurality of fields for respective ones of a failure type, a log file type, an identifier of a storage node of the storage system, and a score for the corresponding preprocessed log file;
• and
• wherein a failure feature is determined for use in the failure analysis model at least in part by aggregating the scores for multiple ones of the preprocessed log files based on one or more of the failure type, the storage node identifier and the log file type.