Systems and methods for enhanced data generation in fault diagnosis

A computing device configured to generate audio to obtain manipulated audio data that includes one or more audio features indicative of faults, the computing device including a processing device configured to execute instructions stored in memory to:

• receiving textual descriptions of audio associated with operation of a device;
• receiving audio data associated with the operation of the device;
• generating, based on the textual descriptions, descriptive text inputs of audio features associated with the operation of the device, wherein the descriptive text inputs include at least one of audio characteristics of faults associated with the operation of the device, contextual information associated with the operation of the device, and conditions associated with the operation of the device;
• generating the manipulated audio data based on the descriptive text inputs and the audio data, wherein the manipulated audio data includes one or more audio features indicative of faults associated with the descriptive text inputs;
• training a machine learning (ML) model to diagnose the faults using the manipulated audio data, wherein the ML model is trained to generate an output indicative of the faults based on audio data obtained during the operation of the device;
• and
• based on convergence during the training, outputting a trained ML model configured to generate the output indicative of the faults.

A system configured to generate audio to obtain manipulated audio data that includes one or more features indicative of faults corresponding to operation of a computer-controlled machine, the system comprising:

• a control system configured to
• receive textual descriptions of audio associated with the operation of the computer-controlled machine,
• receive audio data associated with the operation of the computer-controlled machine,
• generate, based on the textual descriptions, descriptive text inputs of audio features associated with the operation of the computer-controlled machine, wherein the descriptive text inputs include at least one of audio characteristics of faults associated with the operation of the device, contextual information associated with the operation of the computer-controlled machine, and conditions associated with the operation of the computer-controlled machine,
• generate the manipulated audio data based on the descriptive text inputs and observed audio data corresponding to the operation of the computer-controlled machine, wherein the manipulated audio data includes one or more audio features indicative of faults associated with the descriptive text inputs, and
• train a machine learning (ML) model to diagnose the faults using the manipulated audio data, wherein the ML model is trained to generate an output indicative of the faults based on audio data obtained during the operation of the computer-controlled machine, and
• output a control signal based on the output;
• and
• an actuator configured to control the operation of the computer-controlled machine based on the control signal.