Method for Monocular Acquisition of Realistic Three-Dimensional Scene Models
AssigneeCinemersive Labs Ltd
InventorsVictor Lempitskiy, Pavel Solovev
Life of this patent
Estimating the term…
Loading patent…
AssigneeCinemersive Labs Ltd
InventorsVictor Lempitskiy, Pavel Solovev
Estimating the term…
Systems and methods for creating a three-dimensional digital model of a scene from a two-dimensional input image of the scene are described. One aspect includes receiving the two-dimensional input image of the scene, and predicting a latent tensor from the input image. The latent tensor comprises three-dimensional geometrical information of the received two-dimensional input image and information about one or more surfaces occluded in the received two-dimensional input image. The latent tensor and the received two-dimensional image may be inputs to the reconstruction neural network that predicts a three-dimensional model. A paired dataset of input images and corresponding latent tensors may be obtained by a joint training of the reconstruction neural network and an encoding neural network that outputs latent tensors from multiview inputs. The process that predicts the latent tensor from the single input image may then be trained on the paired dataset.
A method for creating a three-dimensional digital model of a scene from a two-dimensional input image of the scene, the method comprising:
A system for creating a three-dimensional digital model of a scene from a two-dimensional input image of the scene, the system comprising:
A method for training a prediction process, the method comprising:
A system for training a prediction process, the method comprising:
Dependencies are inferred from the claim text.