System and method for depth completion and three-dimensional reconstruction of an image area

A system for video processing, comprising:

• a processor;
• and
• memory storing instructions, which when executed by at least one processor, cause the processor to:
• input attribute data and a sparse-depth map associated with an image area into a sparse-depth completion network;
• generate a refined dense-depth map based on the attribute data and the sparse-depth map using the sparse-depth completion network;
• perform a three-dimensional (3D) reconstruction procedure based on the refined dense-depth map to generate a point cloud of the image area;
• perform a triangular-meshing procedure to generate a mesh model based on the point cloud of the image area;
• perform a texture-mapping procedure based on the mesh model and the attribute data to generate a textured mesh of the image area and
• perform a vertex-normal procedure based on the textured mesh to generate a 3D representation of the image area.

A non-transitory computer-readable medium storing instructions, which when executed by a processor of a video-processing system, cause the processor to:

• input attribute data and a sparse-depth map associated with an image area into a sparse-depth completion network;
• generate a refined dense-depth map based on the attribute data and the sparse-depth map using the sparse-depth completion network;
• perform a three-dimensional (3D) reconstruction procedure based on the refined dense-depth map to generate a point cloud of the image area;
• perform a triangular-meshing procedure to generate a mesh model based on the point cloud of the image area;
• perform a texture-mapping procedure based on the mesh model and the attribute data to generate a textured mesh of the image area;
• and
• perform a vertex-normal procedure based on the textured mesh to generate a 3D representation of the image area.