Real-time multiview video conversion method and system
AssigneeLeia Spv LLC
InventorNicolas Dahlquist
Life of this patent
Estimating the term…
Abstract
Systems and methods are directed to real-time multiview video conversion. This conversion may involve receiving a video stream including two-dimensional (2D) frames, where each 2D frame corresponds to a respective 2D video timestamp. In addition, a camera baseline and a center viewpoint are identified. These parameters may be user-specified or predetermined. A target timestamp for a view of a multiview frame may be determined based on the camera baseline and the center viewpoint. The view is generated from a subset of 2D frames having 2D video timestamps adjacent to the target timestamp. A multiview video is rendered for display, where the multiview video comprises the view of the multiview frame.
Claims20
A computer-implemented method of real-time multiview video conversion, the method comprising:
- receiving a video stream comprising two-dimensional (2D) frames by a computing device, each 2D frame corresponding to a respective 2D video timestamp;
- identifying a camera baseline and a center viewpoint by the computing device, wherein the camera baseline defines an interval between views of a multiview frame, and the center viewpoint is a midpoint in a range of views of the multiview frame;
- determining a respective target timestamp for each view of the multiview frame based on the camera baseline and the center viewpoint by the computing device;
- using the determined target timestamps, generating views of the multiview frame from respective subsets of 2D frames having 2D video timestamps adjacent to the target timestamp for each respective view by the computing device;
- and
- rendering a multiview video for display by the computing device, the multiview video comprising the multiview frame.
A system configured to perform real-time multiview video conversion, the system comprising:
- a central processing unit;
- and
- a memory that stores a plurality of instructions, which, when executed, cause the central processing unit to:
- load into a memory buffer a series of two-dimensional (2D) frames, each 2D frame corresponding to a respective 2D video timestamp;
- determine a respective target timestamp for each view of a multiview frame based on a camera baseline and a center viewpoint, wherein the camera baseline defines an interval between views of the multiview frame, and the center viewpoint is a midpoint in a range of views of the multiview frame;
- and
- using the determined target timestamps, generate views of the multiview frame from respective subsets of 2D frames having 2D video timestamps adjacent to the target timestamp for each respective view,
- wherein the views of the multiview frame comprise part of a multiview video configured to be rendered on a multiview display.
A non-transitory, computer-readable storage medium storing executable instructions that, when executed by a processor of a computer system, performs operations of multiview video conversion in real time, the operations comprising:
- receiving a video stream comprising a series of two-dimensional (2D) frames, each 2D frame corresponding to a respective 2D video timestamp;
- determining a respective target timestamp for each view of a multiview frame, the target timestamps being adjacent to respective sets of 2D video timestamps that correspond to a set of 2D frames for each respective view;
- blending each set of 2D frames to generate a corresponding respective view of the multiview frame;
- and
- rendering a multiview video for display while receiving the video stream, the multiview video comprising the multiview frame.
Dependencies are inferred from the claim text.