Method and system providing augmented reality for mining operations

An augmented reality system adapted for use in a mining operation of a first block, the system comprising:

• at least two cameras that are adapted to capture at least two video streams from different positions;
• a position acquisition unit that is adapted to obtain position information of the at least two cameras;
• an image recognition unit that is adapted to recognize features in the at least two video streams and to obtain image data related to the feature from the at least two video streams;
• a calculation unit that is adapted to determine, based on the image data, at least one parameter of the feature;
• an image augmentation unit that is adapted to create an augmented video stream by overlaying at least one of the video stream in real time with content that is based on the parameter;
• and
• a display that is adapted to visualize, in real time, the augmented video stream to an operator of a vehicle that is deployed in the mining operation, the vehicle being embodied as a wheel loader or an excavator and configured for removing blocks from an exploitation site,
• wherein:
• the at least two video streams are video streams of the mining operation of the first block, each of the two video streams imaging the exploitation site and a multitude of blocks situated at the exploitation site;
• the image recognition unit is adapted to recognize the first block in the video streams based on operator input, the operator input being provided by the operator selecting, in one of the at least one visualized video streams, the first block from the multitude of blocks, and to extract image data of the first block from the video streams;
• the calculation unit is adapted to determine, based on the image data of the first block, at least one parameter that is related to the first block, wherein determining the at least one parameter comprises calculating or estimating a weight of the first block based on the image data, and to determine, based at least on an excavation capacity of the vehicle and on the weight of the first block, whether the first block should be removed or not;
• and
• the image augmentation unit is adapted to create the augmented video stream in such a way that an image of the first block in the video stream is accentuated and the video stream is overlaid in real time with information related to the first block, the information including an instruction to the operator as to whether or not the first block should be removed according to the determination of the calculation unit.