Supplying HMI snapshots from industrial automation environments as input to machine learning models

A non-transitory computer-readable medium having stored thereon instructions to support analyzing operating conditions that, in response to execution, cause a system comprising a processor to perform operations, the operations comprising:

• obtaining:
• one or more images of a human-machine interface in an industrial automation environment, wherein the one or more images of the human-machine interface include at least one visual depiction of data collected from an industrial device in the industrial automation environment;
• and
• one or more images of the industrial device captured in the industrial automation environment:
• providing the one or more images of the human-machine interface and the one or more images of the industrial device to a machine learning model trained to analyze an operating condition of the industrial device in the industrial automation environment based on the one or more images of the human-machine interface and the one or more images of the industrial device;
• and
• based on an output of the machine learning model, identifying a current operating condition of the industrial device, wherein the current operating condition is indicative of at least one issue related to performance of the industrial device.

A method for analyzing operating conditions in industrial automation environments, the method comprising:

• obtaining-capturing, by a system comprising a processor:
• one or more images of a human-machine interface in an industrial automation environment, wherein the one or more images of the human-machine interface include at least one visual depiction of data collected from an industrial device in the industrial automation environment;
• and
• one or more images of the industrial device captured in the industrial automation environment;
• providing, by the system, the one or more images of the human-machine interface and the one or more images of the industrial device to a machine learning model trained to analyze an operating condition of the industrial device in the industrial automation environment based on the one or more images of the human-machine interface and the one or more images of the industrial device;
• and
• based on an output of the machine learning model, identifying, by the system, a current operating condition of the industrial device, wherein the current operating condition is indicative of at least one issue related to performance of the industrial device.