Computer vision systems and methods for generating building models using three-dimensional sensing and augmented reality techniques

A computer vision system for generating a model of a building, comprising:

• a mobile device including a three-dimensional sensor, a camera, and a processor;
• and
• a memory in communication with the processor and storing modeling code, the processor executing the modeling code to perform the steps of:
• acquiring an image frame from the camera, the image frame depicting at least part of a building to be modeled;
• acquiring three-dimensional data from the three-dimensional sensor;
• processing the image frame and the three-dimensional data to detect a building object in the building frame;
• determining an augmented reality (AR) icon based on a type of the building object;
• displaying the AR icon on a display of the mobile device superimposed on the image frame, the AR icon adjustable relative to the building object displayed in the image frame;
• allowing a user to capture the building object using the AR icon;
• and
• generating a complete model of the building including the building object.