Systems and methods in digital image processing for generating graphical three-dimensional models of the real-world environment from two or more two-dimensional images

A system comprising:

• one or more processors;
• and
• one or more non-transitory computer-readable storage media coupled to the one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
• obtaining, though an application programming interface (API), a series of two-dimensional (2D) images of a scene taken by an image capturing device;
• extracting key images from the series of 2D images, wherein each of the key images depicts one or more components of a building structure in the scene;
• determining, based on the extracted key images, a respective position and a respective direction of the image capturing device relative to each of the one or more components of the building structure;
• and
• processing, using a 3D image generation neural network, the extracted key images and the positions and directions of the image capturing device to generate metadata comprising a three-dimensional (3D) digital model of the building structure.

One or more non-transitory computer-readable storage media coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

• obtaining, though an application programming interface (API), a series of two-dimensional (2D) images of a scene taken by an image capturing device;
• extracting key images from the series of 2D images, wherein each of the key images depicts one or more components of a building structure in the scene;
• determining, based on the extracted key images, a respective position and a respective direction of the image capturing device relative to each of the one or more components of the building structure;
• and
• processing, using a 3D image generation neural network, the extracted key images and the positions and directions of the image capturing device to generate metadata comprising a three-dimensional (3D) digital model of the building structure.

A computer-implemented method for 3D image processing with image unwarping and corner restoration, the method comprising:

• determining if a wall layout originates from a predefined automation or labeling process;
• reading room reconstruction parameters from a specified path;
• accessing a directory with images and data files;
• loading RGB images and association JSON files into a memory;
• identifying damaged and non-damaged rooms through a damage super-category within the JSON files;
• processing the RGB images to validate and adjust wall layouts, restore polygon corners, and perform unwarping tasks;
• classifying unwarped entities based on a type of each unwarped entity;
• storing relevant unwarping data;
• and
• generating a new parameters file for subsequent reconstruction activities.