Coordinate Geometry Augmented Reality Process

A mobile device for providing coordinate geometry augmented reality for visualizing a 3D digital model in a real environment, the mobile device comprising:

• a processor;
• a computer-readable medium coupled to the processor and storing a plurality of instructions, which, when executed, cause the processor to provide coordinate geometry augmented reality, the plurality of instructions comprising:
• instructions that cause the processor to capture, using a camera of a mobile device, an image of a physical marker placed on or around a physical structure in the real environment, wherein the physical marker is placed at a predetermined set of coordinates, determined by surveying equipment, at or around a tie-in location for an unbuilt element to be added to the physical structure according to a design;
• instructions that cause the processor to analyze the image of the physical marker to determine a supplemental digital model that represents the unbuilt element associated with a digital marker, which corresponds to the physical marker;
• instructions that cause the processor to retrieve, from data storage, a data file comprising the supplemental digital model associated with the digital marker and relation data between the supplemental digital model and the digital marker;
• and
• instructions that cause the processor to provide, on a display screen of the mobile device, an augmented reality image comprising a real view of the physical structure seen through the camera in real-time, overlaid with the supplemental digital model in relation to the physical marker according to the relation data so that the supplemental digital model representing the unbuilt element is seen in a geometrically correct orientation with respect to the physical structure according to the design.

A method of providing coordinate geometry augmented reality for visualizing a 3D digital model in a real environment, the method comprising:

• surveying the real environment with a physical structure, with targets positioned at control points on or around the physical structure, to determine coordinates of the control points in relation to a real-world coordinate system;
• scanning, with a 3D laser scanner, the physical structure and the targets positioned at the control points in the real environment to generate point cloud data having a number of scan points associated with the physical structure, wherein each scan point is georeferenceable on the real-world coordinate system based on the determined coordinates of the targets positioned at the control points;
• generating a physical structure digital model based on the point cloud data and the determined coordinates of the targets at the control points wherein the physical structure digital model is embedded with coordinate data in relation to the real-world coordinate system;
• incorporating a digital model representing an unbuilt element into the physical structure digital model at a desired tie-in location, thereby embedding the supplemental digital model with the coordinate data in relation to the real-world coordinate system;
• selecting at least a portion of the digital model of the unbuilt element to be used as a supplemental digital model for rendering augmented reality visualization;
• selecting a marker location in relation to the supplemental digital model and extracting coordinates associated with the marker location;
• associating the supplemental digital model with a selected digital marker at the marker location so that the supplemental digital model is configured to be sized, positioned, and oriented with respect to the digital marker according to relation data;
• storing a data file comprising the supplemental digital model and the relation data in data storage, wherein the data file is retrievable from the data storage when a physical marker, which corresponds to the selected digital marker, is detected in the real environment by a mobile device;
• surveying the real environment to determine the marker location using the extracted coordinates.

The method for providing coordinate geometry augmented reality off-site, the method comprising:

• providing a scaled-down 3D printed object of a physical structure in a real environment, wherein the 3D printed object is printed by a 3D printer based on a 3D digital model of the physical structure generated by surveying and laser scanning the physical structure in the real world environment;
• providing a physical marker on the 3D printed object at or around a position that corresponds to a tie-in location between the physical structure and an unbuilt design element to be added to the physical structure;
• capturing an image of the physical marker on the 3D printed object using a mobile device running an augmented reality application;
• analyzing, using a processor, the image of the physical marker to determine a 3D digital model of the unbuilt element associated with the physical marker;
• retrieving, from data storage, a data file comprising the 3D digital model of the unbuilt element associated with a digital marker that corresponds to the physical marker;
• and
• providing, on a display screen of the mobile device, an augmented reality image comprising a real view of the 3D printed object seen through the camera in real-time, overlaid with the 3D digital model of the unbuilt element, wherein the 3D digital model of the unbuilt element is displayed according to the marker location and orientation so that the 3D digital model of the unbuilt element is seen in a geometrically correct orientation with respect to the 3D printed object.