# US 2021/0243472 A1 · Method and device for multi-view video decoding and method and device for image processing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0243472 A1 - Document ID: US20210243472A1 - Status: Published application - Kind: A1 - Application number: 17/052,342 - Filed: 2019-04-16 - Published: 2021-08-05 - Earliest claimed: 2018-05-03 - Assignees: Orange - Applicants: Orange - Inventors: Joel Jung; Pavel Nikitin; Patrick Boissonade - Web page: https://patentgrep.com/patent/US20210243472A1 ## CPC - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 19/172: the region being a picture, frame or field - H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method and a device for decoding a data stream representative of a multi-view video. Syntax elements are obtained from at least one part of the stream data, and used to reconstruct at least one image of a view of the video. Then, at least one item of metadata in a predetermined form is obtained from at least one obtained syntax element, and provided to an image processing module. Also provided are a method and a device for processing images configured to read said at least one item of metadata in the predetermined form and use it to generate at least one image of a virtual view from a reconstructed view of the multi-view video. ## Claims ### Claim 1 A decoding method for decoding a data stream representative of a multi-view video, implemented by a decoding device, the method comprising: obtaining syntax elements from at least one part of the stream data; reconstructing at least one image of a view of the video from the syntax elements obtained; obtaining at least one item of metadata in a predetermined form from at least one syntax element; and providing said at least one item of metadata to an image synthesis module. ### Claim 2 (depends on 1) The decoding method according to claim 1, wherein obtaining at least one item of metadata further comprises calculating said at least one item of metadata from at least one part of the syntax elements. ### Claim 3 (depends on 1) The decoding method according to claim 1, wherein said at least one item of metadata is not used for reconstructing the at least one image. ### Claim 4 (depends on 1) The decoding method according to claim 1, wherein said at least one item of metadata corresponds to an item of information included in the group consisting of: camera parameters, decoded and scaled motion vectors, a partitioning of the reconstructed image, a reference image used by a block of an image of the reconstructed view, the coding modes of an image of the reconstructed view, quantization parameter values of an image of the reconstructed view, prediction residual values of an image of the reconstructed view, a map representative of the movement in an image of the reconstructed view, a map representative of the presence of occlusions in an image of the reconstructed view, a map representative of confidence values associated with a depth map. ### Claim 5 (depends on 1) The decoding method according to claim 1, wherein the predetermined form corresponds to an indexed table in which at least one item of metadata is stored in association with an index. ### Claim 6 (depends on 1) The decoding method according to claim 1, wherein said at least one item of metadata is obtained based on a granularity level specified in the decoding device. ### Claim 7 (depends on 1) The decoding method according to claim 1, further comprising receiving by the decoding device a request from the image synthesis module indicating at least one item of metadata required by the image synthesis module. ### Claim 8 (depends on 7) The decoding method according to claim 7, wherein the request comprises at least one index indicating the required item of metadata among a predetermined list of available metadata. ### Claim 9 A device for decoding a data stream representative of a multi-view video, wherein the device comprises: a processor; and a non-transitory computer-readable medium comprising instructions stored thereon which when executed by the processor configure the decoding device to: obtain syntax elements from at least one part of the stream data; reconstruct at least one image of a view of the video from the syntax elements obtained; obtain at least one item of metadata in a predetermined form from at least one syntax element; and provide said at least one item of metadata to an image synthesis module. ### Claim 10 An image synthesis method implemented by a synthesis device, the method comprising: generating at least one image of a virtual view, from at least one image of a view decoded by a decoding device by: reading at least one item of metadata in a predetermined form, said at least one item of metadata being obtained by the decoding device from at least one syntax element obtained from a data stream representative of a multi-view video; and generating said at least one image comprising using said at least one read item of metadata. ### Claim 11 (depends on 10) The image synthesis method according to claim 10, further comprising sending to the decoding device a request indicating at least one item of metadata required to generate the image. ### Claim 12 An image synthesis device configured to generate at least one image of a virtual view, from at least one image of a view decoded by a decoding device, the image synthesis device comprising: a processor; and a non-transitory computer-readable medium comprising instructions stored thereon which when executed by the processor configure the image synthesis device to: read at least one item of metadata in a predetermined form, said at least one item of metadata being obtained by the decoding device from at least one syntax element obtained from a data stream representative of a multi-view video; and generating said at least one image using said at least one read item of metadata. ### Claim 13 (canceled) ### Claim 14 A non-transitory computer-readable medium comprising a computer program stored thereon comprising instructions for implementing a decoding method when said program is executed by a processor of a decoding device, wherein the instructions configure the decoding device to: decode a data stream representative of a multi-view video by: obtaining syntax elements from at least one part of the stream data; reconstructing at least one image of a view of the video from the syntax elements obtained; obtaining at least one item of metadata in a predetermined form from at least one syntax element; and providing said at least one item of metadata to an image synthesis module.