System and method for occlusion reconstruction in surround views using temporal information

A system for occlusion reconstruction in surround views using temporal information, the system comprising:

• a device including:
• an active camera device generating image data describing a first view of an operating environment;
• and
• a computerized visual data controller, including programming to:
• analyze the image data to generate a three-dimensional computerized representation of the operating environment;
• utilize the image data and the three-dimensional computerized representation of the operating environment to synthesize a virtual camera view of the operating environment from a desired viewpoint;
• and
• identify an occlusion in the virtual camera view;
• utilize historical iterations of the image data and identify immobile objects within the operating environment;
• utilize the historical iterations of the image data to estimate filled information for the occlusion;
• reconstruct the occlusion in the three-dimensional computerized representation with the filled information using pixel data from the immobile objects;
• and
• utilize the three-dimensional computerized representation to provide navigational guidance within the operating environment.

A method for occlusion reconstruction in surround views using temporal information, the method comprising:

• operating an active camera device to collect image data describing a first view of an operating environment;
• and
• within a computerized processor:
• receiving the image data from the active camera device;
• analyzing the image data to generate a three-dimensional computerized representation of the operating environment;
• utilizing the image data and the three-dimensional computerized representation of the operating environment to synthesize a virtual camera view of the operating environment from a desired viewpoint;
• identifying an occlusion in the virtual camera view;
• utilizing historical iterations of the image data and identify immobile objects within the operating environment;
• utilizing the historical iterations of the image data to estimate filled information for the occlusion;
• reconstructing the occlusion in the three-dimensional computerized representation with the filled information using pixel data from the immobile objects;
• and
• utilizing the three-dimensional computerized representation to provide navigational guidance within the operating environment. The method of claim 14, wherein analyzing the image data includes performing depth interpretation and semantic segmentation upon the image data.