Operator assistance vision system

A method for assisting an operator of a machine based on an image of an environment of the machine captured by an image capturing device mounted on the machine, the method comprising:

• receiving, by a controller, the image of the environment of the machine;
• applying, by the controller, an object detection process to detect an object in the image;
• determining, by the controller, a bounding box comprising one or more pixels associated with the object;
• determining, by the controller, a height and a range associated with the object based on the bounding box;
• extracting, by the controller, the one or more pixels associated with the object from the image;
• generating, by the controller, a three-dimensional (3D) view comprising the object based on the image captured by the image capturing device;
• and
• reinserting, by the controller, the one or more pixels as a vertical pop-up element with respect to a ground plane at a location of the object in the 3D view.

A computer-program product for use in conjunction with an image capturing device and a display, wherein the image capturing device is configured to capture an image of an environment of a machine, the computer-program product comprising a non-transitory computer-readable storage medium having instructions for causing a processor to:

• apply an object detection process to detect an object in the image;
• determine a bounding box comprising one or more pixels associated with the object;
• determine a height and a range associated with the object based on the bounding box;
• extract the one or more pixels associated with the object from the image;
• generate a three-dimensional (3D) view comprising the object based on the image captured by the image capturing device;
• and
• reinsert the one or more pixels as a vertical pop-up element with respect to a ground plane at a location of the object in the 3D view.