Augmented reality (AR) display of pipe inspection data

A device, comprising:

• a display device,
• a camera;
• a processor;
• and
• a memory that stores processor executable instructions comprising:
• instructions that obtain, using the processor, pipe inspection data derived from a pipe inspection robot that traverses through the interior of an underground pipe, the pipe inspection data including one or more sets of condition assessment data relating to an interior of the underground pipe;
• instructions that obtain, using the camera, real-time visual image data of an above-ground surface;
• instructions that combine, using the processor, the pipe inspection data with the real-time visual image data in an augmented reality (AR) scene;
• instructions that display, using the display device, the AR scene;
• wherein:
• the pipe inspection data comprises data relating to an in-ground position of the underground pipe;
• the real-time visual image data comprises surface feature data indicating a position of a surface feature;
• and
• the instructions that combine comprise instructions that use the data relating to the in-ground position of the underground pipe to align at least a part of the pipe inspection data with the surface feature in the real-time visual image data;
• instructions that use computer vision to detect the surface feature in the real-time visual image;
• and
• instructions that detect a related in-ground position feature in the pipe inspection data to align the at least a part of the pipe inspection data with the surface feature in the real-time visual image data;
• wherein:
• the surface feature in the real-time visual image comprises at least a part of a physical man hole cover;
• and
• the related in-ground position feature in the pipe inspection data comprises a gap in the pipe inspection data associated with an opening in the underground pipe for a manhole.

A computer program product, comprising:

• a non-transitory storage medium that stores processor executable instructions, comprising:
• instructions that obtain pipe inspection data derived from a pipe inspection robot that traverses through the interior of an underground pipe, the pipe inspection data including one or more sets of condition assessment data relating to an interior of the underground pipe;
• instructions that obtain real-time visual image data of an above-ground surface;
• instructions that combine the pipe inspection data with the real-time visual image data in an augmented reality (AR) scene;
• instructions that display, using the display device, the AR scene;
• wherein:
• the pipe inspection data comprises data relating to an in-ground position of the underground pipe;
• the real-time visual image data comprises surface feature data indicating a position of a surface feature;
• and
• the instructions that combine comprise instructions that use the data relating to the in-ground position of the underground pipe to align at least a part of the pipe inspection data with the surface feature in the real-time visual image data;
• instructions that use computer vision to detect the surface feature in the real-time visual image;
• and
• instructions that detect a related in-ground position feature in the pipe inspection data to align the at least a part of the pipe inspection data with the surface feature in the real-time visual image data;
• wherein:
• the surface feature in the real-time visual image comprises at least a part of a physical man hole cover;
• and
• the related in-ground position feature in the pipe inspection data comprises a gap in the pipe inspection data associated with an opening in the underground pipe for a manhole.