Real-time view synthesis
AssigneeGoogle Inc.
InventorsRyan Styles Overbeck, Michael Joseph Broxton, Lukas Murmann, John Patrick Flynn, Daniel William Erickson
Life of this patent
Estimating the term…
Abstract
A method including receiving a plurality of two-dimensional (2D) images representing a frame of a streaming three-dimensional (3D) video, generating a plurality of meshes corresponding to one of the plurality of 2D images, generating a synthesized mesh based on the plurality of meshes, generating a left-eye 3D image and depth based on the synthesized mesh, and generating a right-eye 3D image and depth map based on the synthesized mesh, the left-eye 3D image and depth map and the right-eye 3D image and depth map having a viewpoint perspective based on a receiver of the streaming 3D video.
Claims21
A method comprising:
- receiving a plurality of two-dimensional (2D) images representing a frame of a streaming three-dimensional (3D) video;
- generating a plurality of meshes corresponding to the plurality of 2D images;
- generating a synthesized mesh based on the plurality of meshes;
- generating a left-eye 3D image and depth based on the synthesized mesh;
- and
- generating a right-eye 3D image and depth map based on the synthesized mesh, the left-eye 3D image and depth map and the right-eye 3D image and depth map having a viewpoint perspective based on a receiver of the streaming 3D video.
A non-transitory computer-readable storage medium comprising instructions stored thereon that, when executed by at least one processor, are configured to cause a computing system to:
- receive a plurality of two-dimensional (2D) images representing a frame of a streaming three-dimensional (3D) video;
- generate a plurality of meshes corresponding to the plurality of 2D images;
- generate a synthesized mesh based on the plurality of meshes;
- generate a left-eye 3D image and depth based on the synthesized mesh;
- and
- generate a right-eye 3D image and depth map based on the synthesized mesh, the left-eye 3D image and depth map and the right-eye 3D image and depth map having a viewpoint perspective based on a receiver of the streaming 3D video.
11-12. (canceled)
An apparatus comprising:
- at least one processor;
- and
- at least one memory including computer program code;
- the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to:
- receive a plurality of two-dimensional (2D) images representing a frame of a streaming three-dimensional (3D) video;
- generate a plurality of meshes corresponding to the plurality of 2D images;
- generate a synthesized mesh based on the plurality of meshes;
- generate a left-eye 3D image and depth based on the synthesized mesh;
- and
- generate a right-eye 3D image and depth map based on the synthesized mesh, the left-eye 3D image and depth map and the right-eye 3D image and depth map having a viewpoint perspective based on a receiver of the streaming 3D video.
Dependencies are inferred from the claim text.