Method, apparatus and system for monitoring a condition associated with operating heavy equipment such as a mining shovel or excavator

Abstract

A computer processor implemented method and system for monitoring a condition associated with operating heavy equipment is disclosed. The method involves receiving a plurality of images at an interface of an embedded processor disposed on the heavy equipment, the images providing a view of at least an operating implement of the heavy equipment. The method also involves processing each of the plurality of images using a first neural network implemented on the embedded processor, the first neural network having been previously trained to identify regions of interest within the image. Each region of interest has an associated designation as at least one of a critical region suitable for extraction of critical operating condition information required for operation of the heavy equipment, and a non-critical region suitable for extraction of non-critical operating condition information associated with the operation of the heavy equipment. The method further involves causing the embedded processor to initiate further processing of image data associated with critical regions to generate local output operable to alert an operator of the heavy equipment of the associated critical operating condition. The method also involves transmitting image data associated with non-critical regions to a remote processor, the remote processor being operably configured for further processing of the image data and to generate output signals representing results of the further processing. The method further involves receiving the output signals generated by the remote processor at one of the embedded processor or another processor associated with a heavy equipment operations worksite, the output signals being presentable via an electronic user interface based at least in part on the output signals to indicate the results of the further processing.

Dependencies are inferred from the claim text.