# US 2014/0192148 A1 · Encoder, Method in an Encoder, Decoder and Method in a Decoder for Providing Information Concerning a Spatial Validity Range > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0192148 A1 - Document ID: US20140192148A1 - Status: Published application - Kind: A1 - Application number: 14/238,482 - Filed: 2012-05-24 - Published: 2014-07-10 - Earliest claimed: 2011-08-15 - Assignees: Telefonaktiebolaget L M Ericsson (publ) - Inventors: Apostolos Georgakis; Andrey Norkin; Thomas Rusert - Web page: https://patentgrep.com/patent/US20140192148A1 ## CPC - H04N 13/111: Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation - H04N 13/128: Adjusting depth or disparity - H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) - H04N 13/178: Metadata, e.g. disparity information - H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 13/243: using three or more two-dimensional [2D] image sensors - H04N 19/553: Motion estimation dealing with occlusions - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Methods (700, 900) for providing information from an encoder (220) to a decoder (230) concerning a spatial validity range, at which view synthesis of an image at a virtual camera position can be performed with sufficient visual quality, based on a view of at least one real camera (210-1) comprised in a set of real cameras (210-1, 210-2, 210-3, 210-4). The methods (700, 900) comprises determining (701) the spatial validity range of the at least one real camera (210-1), which spatial validity range specifies for the decoder (230) what information to use for synthesising the image of the virtual camera position. Also, the determined (701) spatial validity range is transmitted (706) to the decoder (230). ## Claims ### Claim at position 1 1-31. (canceled) ### Claim 32 A method in a decoder for receiving information from an encoder concerning a spatial validity range at which view synthesis of an image at a virtual camera position is enabled, which view synthesis is based on a view of at least one real camera comprised in a set of real cameras, wherein the spatial validity range comprises coordinates, the method comprising: receiving the spatial validity range of the at least one real camera from the encoder, which spatial validity range specifies, for the decoder, information to use for synthesizing the image of the virtual camera position, the information comprising at least some of textures, depth maps, occlusion maps and occlusion depth; selecting the virtual camera position; and determining that the selected virtual camera position is situated within the received spatial validity range, wherein the view synthesis is performable when the virtual camera position is considered to be situated within the spatial validity range. ### Claim 33 (depends on 32) The method of claim 32, wherein the received spatial validity range of the at least one real camera comprises a common view synthesis range for a set of multiple views of the set of real cameras, and wherein the action of determining comprises determining that the selected virtual camera position is situated within the received common view synthesis range. ### Claim 34 (depends on 32) The method of claim 32, further comprising receiving information, from the encoder, indicating that the validity range comprises a union between the common view synthesis range and the spatial validity range of the at least one real camera. ### Claim 35 (depends on 32) The method of claim 32, further comprising receiving information, from the encoder, indicating that the spatial validity range of the at least one real camera is to be replaced by the common view synthesis range for the set of multiple views of the set of real cameras. ### Claim 36 (depends on 32) The method of claim 32, further comprising: receiving data representing the view of the at least one real camera together with the received spatial validity range; and synthesizing the image of the virtual camera position, based on the data representing the view of the at least one real camera. ### Claim 37 (depends on 36) The method of claim 36, wherein synthesizing the image of the virtual camera position is based on the received common view synthesis range for the set of multiple views of the set of real cameras. ### Claim 38 (depends on 36) The method of claim 36, further comprising receiving a confidence index of the at least one real camera, wherein the action of synthesizing is further based on the received confidence index. ### Claim 39 (depends on 36) The method of claim 36, wherein the action of synthesizing the image of the virtual camera position is not performed when it has been determined that the selected virtual camera position is not situated within the received spatial validity range. ### Claim 40 (depends on 39) The method of claim 39, wherein the action of synthesising the image of the virtual camera position further comprises selecting another virtual camera position, situated inside the received spatial validity range. ### Claim 41 (depends on 32) The method of claim 32, wherein the spatial validity range of the real camera is received from the encoder as a maximum coordinate and a minimum coordinate in a coordinate system. ### Claim 42 (depends on 32) The method of claim 32, wherein the at least one view of the real camera comprises a frame and wherein different parts of the frame have different spatial validity ranges. ### Claim 43 (depends on 32) The method of claim 32, wherein information indicating which hole filling methodology to be used is received from the encoder. ### Claim 44 (depends on 32) The method of claim 32, wherein the spatial validity range is comprised in a Supplementary Enhancement Information (SEI) message. ### Claim 45 (depends on 32) The method of claim 32, wherein the coordinates determining the spatial validity range of the at least one real camera comprise an offset from center coordinates of the at least one real camera. ### Claim 46 (depends on 32) The method of claim 32, wherein the decoder comprises, or is associated with, a view synthesizer wherein the action of synthesizing the image of the virtual camera position is performed. ### Claim 47 A decoder for receiving information from an encoder concerning a spatial validity range, at which view synthesis of an image at a virtual camera position is enabled, which view synthesis is based on a view of at least one real camera comprised in a set of real cameras, wherein the spatial validity range comprises coordinates, the decoder comprising: an input section configured to receive the spatial validity range of the at least one real camera from the encoder, which spatial validity range specifies for the decoder what information to use for synthesizing the image of the virtual camera position, wherein said what information comprises at least some of textures, depth maps, occlusion maps and occlusion depth; a processing circuit configured to select the virtual camera position, and also configured to determine that the selected virtual camera position is situated within the received spatial validity range, wherein the view synthesis is performable when the virtual camera position is considered to be situated within the spatial validity range. ### Claim 48 (depends on 47) The decoder of claim 47, wherein the input section is configured to receive, from the encoder, a common view synthesis range for the set of multiple views of the set of real cameras, and the processing circuit is configured to determine that the selected virtual camera position is situated within the received common view synthesis range. ### Claim 49 (depends on 47) The decoder of claim 47, wherein the input section is further configured to receive information, from the encoder, indicating that the validity range comprises a union between the common view synthesis range and the spatial validity range of the at least one real camera. ### Claim 50 (depends on 47) The decoder of claim 47, wherein the input section is further configured to receive information, from the encoder, indicating that the spatial validity range of the at least one real camera is to be replaced by the common view synthesis range for the set of multiple views of the set of real cameras. ### Claim 51 (depends on 47) The decoder of claim 47, wherein the input section is configured to receive data representing the view of the at least one real camera from the encoder, and wherein the decoder comprises: a view synthesizer configured to synthesize the three-dimensional auto-stereoscopic image of the virtual camera position, based on the data representing the view of the at least one real camera. ### Claim 52 (depends on 51) The decoder of claim 51, wherein the view synthesizer is configured to synthesize the image of the virtual camera position based on the received common view synthesis range for the set of multiple views of the set of real cameras. ### Claim 53 (depends on 47) The decoder of claim 47, wherein the input section is further configured to receive the spatial validity range of the real camera, from the encoder, as a maximum coordinate and a minimum coordinate in a coordinate system. ### Claim 54 (depends on 47) The decoder of claim 47, wherein the at least one view of the real camera comprises a frame and wherein different parts of the frame have different spatial validity ranges. ### Claim 55 (depends on 47) The decoder of claim 47, wherein the input section is further configured to receive information indicating which hole filling methodology to be used, from the encoder. ### Claim 56 (depends on 47) The decoder of claim 47, wherein the input section is further configured to receive a confidence index of the at least one real camera. ### Claim 57 (depends on 51) The decoder of claim 51, wherein the view synthesizer is further configured to synthesize the image of the virtual camera position further based on the received confidence index. ### Claim 58 (depends on 47) The decoder of claim 47, wherein the spatial validity range is comprised in a Supplementary Enhancement Information (SEI) message. ### Claim 59 (depends on 47) The decoder of claim 47, wherein the coordinates determining the spatial validity range of the at least one real camera, comprise an offset from center coordinates of the at least one real camera. ### Claim 60 (depends on 47) The decoder of claim 47, wherein the decoder is associated with a view synthesizer configured to synthesize the image of the virtual camera position. ### Claim 61 (depends on 47) A receiver comprising a decoder of claim 47 and a view synthesiser, which receiver is configured for generating a view synthesis of an image at a virtual camera position, based on a view of at least one real camera comprised in a set of real cameras.