Representation and Coding of Multi-View Images Using Tapestry Encoding
AssigneeDolby Laboratories Licensing Corporation
InventorsGregory John Ward, Scott Daly
Life of this patent
Estimating the term…
Abstract
Representation and coding of multi-view images using tapestry encoding are described. A tapestry comprises information on a tapestry image and a world coordinates map associated with the tapestry image, each of which may contain information from one or more perspectives of a scene. Perspective images of a scene can be generated from the tapestry image and the world coordinates map.
Claims26
1-59. (canceled)
A method for generating at least one view of a scene from a tapestry image, each of the at least one view being associated with one desired viewpoint of the scene, the method comprising:
- providing the tapestry image;
- wherein the tapestry image comprises a 2 D array of pixels comprising information from a plurality of views associated with the scene;
- providing a coordinates map associated with the tapestry image;
- wherein the position data associated with the pixels of the tapestry image comprise depth data for each pixel in the tapestry image;
- and wherein the position data associated with the pixels of the tapestry image further comprise horizontal disparity data and/or vertical disparity data for each pixel in the tapestry image;
- deriving one or more views of the scene based on the tapestry image and the coordinates map.
An encoding system adapted to receive a plurality of input views of a scene, comprising:
- a tapestry generator adapted to generate a tapestry image and a coordinates map based on the plurality of input views;
- wherein the tapestry image comprises a 2 D array of pixels comprising information from the plurality of input views of the scene;
- wherein the position data associated with the pixels of the tapestry image comprise depth data for each pixel in the tapestry image;
- and wherein the position data associated with the pixels of the tapestry image further comprise horizontal disparity data and/or vertical disparity data for each pixel in the tapestry image;
- and
- an encoder adapted to encode the tapestry image and the coordinates map into a bitstream.
A decoding system adapted to receive a bitstream associated with a scene and adapted to generate one or more output images, comprising:
- a decoder adapted to decode a tapestry image and a coordinates map from the bitstream, wherein the tapestry image and the coordinates map are associated with a plurality of input views of the scene;
- wherein the tapestry image comprises a 2 D array of pixels comprising information from the plurality of input views of the scene;
- wherein the position data associated with the pixels of the tapestry image comprise depth data for each pixel in the tapestry image;
- and wherein the position data associated with the pixels of the tapestry image further comprise horizontal disparity data and/or vertical disparity data for each pixel in the tapestry image;
- and
- a view generation unit adapted to derive the one or more output images of the scene based on the tapestry image and the coordinates map.
Dependencies are inferred from the claim text.