Augmented reality (ar) based fault detection and maintenance

An Artificial intelligence (AI)/Augmented reality (AR) based method of monitoring an equipment comprising:

• analyzing real-time video feed transmitted by a user device, the real-time video feed including images of a facility including an equipment to be worked on;
• obtaining an input image including the equipment from the real-time video feed;
• determining a current context level of a plurality of context levels associated with the equipment in response to obtaining the input image;
• retrieving a resolution step that provides instructions for at least an act to be executed by the user on the equipment, the resolution step being retrieved based on the current context level;
• obtaining an AR simulation to be provided to the user on the user device, the AR simulation corresponding to the resolution step and the AR simulation including one or more of audio and video animations corresponding to the instructions;
• enabling a display of the AR simulation on a current image of the equipment on the user device;
• and
• repeating the steps of determining the context level, retrieving the resolution step, obtaining the AR simulation and enabling a display of the AR simulation on the image until the instructions corresponding to each of the plurality of context levels are executed by the user.

A non-transitory storage medium comprising machine-readable instructions that cause at least one processor to:

• receive real-time video feed from a remote user device, the real-time video feed transmitting video of a facility including equipment;
• identify from the real-time video feed, using a trained AI-based object identifier, a faulty equipment to be repaired;
• further obtain using the trained AI-based object identifier, an input image from the real-time video feed, the input image including a component to be repaired within the faulty equipment;
• classify the input image into one of a plurality of fault classes using an AI-based fault identifier;
• detect a fault associated with the component in the input image based on a comparison of the input image with historical data specific to the equipment and further based on weights associated with attributes of the component;
• determine serially, one of a plurality of context levels at which the fault has been detected based at least on the real-time video feed;
• and
• enable providing a respective resolution step for each of the plurality of context levels, one or more of the respective resolution steps includes enabling display of an augmented reality (AR) projection on an image of the component on a screen of the user device and at least one of the respective resolution steps includes at least one instruction to a user regarding repairing the component.