Method and device for multi-view video decoding and method and device for image processing
AssigneeOrange
InventorsJoel Jung, Pavel Nikitin, Patrick Boissonade
Life of this patent
Estimating the term…
Abstract
A method and a device for decoding a data stream representative of a multi-view video. Syntax elements are obtained from at least one part of the stream data, and used to reconstruct at least one image of a view of the video. Then, at least one item of metadata in a predetermined form is obtained from at least one obtained syntax element, and provided to an image processing module. Also, a method and a device for processing images configured to read the at least one item of metadata in the predetermined form and use it to generate at least one image of a virtual view from a reconstructed view of the multi-view video.
Claims8
A decoding method for decoding a data stream representative of a multi-view video, implemented by a decoding device, the method comprising:
- obtaining syntax elements from at least one part of the data stream;
- reconstructing at least one image of a view of the video from the syntax elements obtained;
- obtaining at least one item of metadata in a predetermined form from at least one syntax element, said at least one item of metadata being associated with said at least one reconstructed image and being not used for reconstructing the at least one image, and said at least one item of metadata corresponding to an item of information included in the group consisting of:
- camera parameters,
- decoded and scaled motion vectors,
- a partitioning of the reconstructed image,
- a reference image used by a block of an image of the reconstructed view,
- coding modes of an image of the reconstructed view,
- quantization parameter values of an image of the reconstructed view,
- prediction residual values of an image of the reconstructed view,
- a map representative of movement in an image of the reconstructed view,
- a map representative of presence of occlusions in an image of the reconstructed view,
- a map representative of confidence values associated with a depth map;
- and
- providing said at least one item of metadata to an image synthesis module, said image synthesis module being configured to synthesize at least one virtual view, distinct from the views of the multi-view video, from said at least one reconstructed image and said at least one item of metadata.
A device for decoding a data stream representative of a multi-view video, wherein the device comprises:
- a processor;
- and
- a non-transitory computer-readable medium comprising instructions stored thereon which when executed by the processor configure the decoding device to:
- obtain syntax elements from at least one part of the stream data;
- reconstruct at least one image of a view of the video from the syntax elements obtained;
- obtain at least one item of metadata in a predetermined form from at least one syntax element, said at least one item of metadata being associated with said at least one reconstructed image and being not used for reconstructing the at least one image, and said at least one item of metadata corresponding to an item of information included in the group consisting of:
- camera parameters,
- decoded and scaled motion vectors,
- a partitioning of the reconstructed image,
- a reference image used by a block of an image of the reconstructed view,
- coding modes of an image of the reconstructed view,
- quantization parameter values of an image of the reconstructed view,
- prediction residual values of an image of the reconstructed view,
- a map representative of movement in an image of the reconstructed view,
- a map representative of presence of occlusions in an image of the reconstructed view,
- a map representative of confidence values associated with a depth map;
- and
- provide said at least one item of metadata to an image synthesis module, said image synthesis module being configured to synthesize at least one virtual view, distinct from the views of the multi-view video, from said at least one reconstructed image and said at least one item of metadata.
A non-transitory computer-readable medium comprising a computer program stored thereon comprising instructions for implementing a decoding method when said program is executed by a processor of a decoding device, wherein the instructions configure the decoding device to:
- decode a data stream representative of a multi-view video by:
- obtaining syntax elements from at least one part of the stream data;
- reconstructing at least one image of a view of the video from the syntax elements obtained;
- obtaining at least one item of metadata in a predetermined form from at least one syntax element, said at least one item of metadata being associated with said at least one reconstructed image and being not used for reconstructing the at least one image, and said at least one item of metadata corresponding to an item of information included in the group consisting of:
- camera parameters,
- decoded and scaled motion vectors,
- a partitioning of the reconstructed image,
- a reference image used by a block of an image of the reconstructed view,
- coding modes of an image of the reconstructed view,
- quantization parameter values of an image of the reconstructed view,
- prediction residual values of an image of the reconstructed view,
- a map representative of movement in an image of the reconstructed view,
- a map representative of presence of occlusions in an image of the reconstructed view,
- a map representative of confidence values associated with a depth map;
- and
- providing said at least one item of metadata to an image synthesis module, said image synthesis module being configured to synthesize at least one virtual view, distinct from the views of the multi-view video, from said at least one reconstructed image and said at least one item of metadata.
Dependencies are inferred from the claim text.