# US 2014/0192157 A1 · View synthesis in 3d video > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0192157 A1 - Document ID: US20140192157A1 - Status: Published application - Kind: A1 - Application number: 14/151,586 - Filed: 2014-01-09 - Published: 2014-07-10 - Earliest claimed: 2013-01-10 - Assignees: QUALCOMM Incorporated - Applicants: QUALCOMM Incorporated - Inventors: Ying Chen; Ye-Kui Wang; Li Zhang - Web page: https://patentgrep.com/patent/US20140192157A1 ## CPC - H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/577: Motion compensation with bidirectional frame interpolation, i.e. using B-pictures - H04N 19/58: Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one (H04N19/23 takes precedence) - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract In an example, a method of decoding video data includes determining whether a reference index for a current block corresponds to an inter-view reference picture, and when the reference index for the current block corresponds to the inter-view reference picture, obtaining, from an encoded bitstream, data indicating a view synthesis prediction (VSP) mode of the current block, where the VSP mode for the reference index indicates whether the current block is predicted with view synthesis prediction from the inter-view reference picture. ## Claims ### Claim 1 A method of decoding video data, the method comprising: determining whether a reference index for a current block corresponds to an inter-view reference picture; and when the reference index for the current block corresponds to the inter-view reference picture, obtaining, from an encoded bitstream, data indicating a view synthesis prediction (VSP) mode of the current block, wherein the VSP mode for the reference index indicates whether the current block is predicted with view synthesis prediction from the inter-view reference picture. ### Claim 2 (depends on 1) The method of claim 1, wherein obtaining the data indicating the VSP mode comprises obtaining a VSP flag at a block level only when the reference index for the current block corresponds to an inter-view reference picture. ### Claim 3 (depends on 2) The method of claim 2, wherein the block level is a macroblock level when the current block is a macroblock or a macroblock partition level when the current block is a macroblock partition. ### Claim 4 (depends on 1) The method of claim 1, further comprising decoding a slice header that does not include an indication of a reference index of a view synthesis reference picture for decoding the current block. ### Claim 5 (depends on 1) The method of claim 1, wherein the data indicating the VSP mode for the current block is obtained only when the reference index for the current block corresponds to a picture in reference picture list zero. ### Claim 6 (depends on 1) The method of claim 1, wherein the data indicating the VSP mode for the current block is obtained when the reference index for the current block corresponds to a picture in one of a first reference picture list and a second reference picture list. ### Claim 7 (depends on 1) The method of claim 1, further comprising obtaining, from an encoded bitstream, data indicating whether to perform one of the VSP mode and a second VSP mode, wherein performing the second VSP mode comprises determining a view synthesis reference picture based on a reference picture index of the view synthesis reference picture. ### Claim 8 (depends on 1) The method of claim 1, further comprising: determining a view synthesis reference picture from the inter-view reference picture; adding the view synthesis prediction picture to a reference picture list, wherein a reference picture list modification process is not used to reorder the view synthesis prediction picture; and decoding the current block relative to the view synthesis reference picture. ### Claim 9 (depends on 1) The method of claim 1, further comprising synthesizing a view synthesis reference picture from the inter-view reference picture only when the inter-view reference picture is included in reference picture list zero. ### Claim 10 (depends on 1) The method of claim 1, further comprising synthesizing a view synthesis reference picture from the inter-view reference picture only when the inter-view reference picture is included in reference picture list one. ### Claim 11 An apparatus for decoding video data, the apparatus comprising: a memory storing video data including a current block; and one or more processors configured to: determine whether a reference index for the current block corresponds to an inter-view reference picture; and when the reference index for the current block corresponds to the inter-view reference picture, obtain, from an encoded bitstream, data indicating a view synthesis prediction (VSP) mode of the current block, wherein the VSP mode for the reference index indicates whether the current block is predicted with view synthesis prediction from the inter-view reference picture. ### Claim 12 (depends on 11) The apparatus of claim 11, wherein to obtain the data indicating the VSP mode, the one or more processors are configured to obtain a VSP flag at a block level only when the reference index for the current block corresponds to an inter-view reference picture. ### Claim 13 (depends on 12) The apparatus of claim 12, wherein the block level is a macroblock level when the current block is a macroblock or a macroblock partition level when the current block is a macroblock partition. ### Claim 14 (depends on 11) The apparatus of claim 11, wherein the one or more processors are further configured to decode a slice header that does not include an indication of a reference index of a view synthesis reference picture for decoding the current block. ### Claim 15 (depends on 11) The apparatus of claim 11, wherein the one or more processors are configured to obtain the data indicating the VSP mode for the current block only when the reference index for the current block corresponds to a picture in reference picture list zero. ### Claim 16 (depends on 11) The apparatus of claim 11, wherein the one or more processors are configured to obtain the data indicating the VSP mode for the current block when the reference index for the current block corresponds to a picture in one of a first reference picture list and a second reference picture list. ### Claim 17 (depends on 11) The apparatus of claim 11, wherein the one or more processors are further configured to obtain, from an encoded bitstream, data indicating whether to perform one of the VSP mode and a second VSP mode, wherein to perform the second VSP mode, the one or more processors are configured to determine a view synthesis reference picture based on a reference picture index of the view synthesis reference picture. ### Claim 18 (depends on 11) The apparatus of claim 11, wherein the one or more processors are further configured to: determine a view synthesis reference picture from the inter-view reference picture; add the view synthesis prediction picture to a reference picture list, wherein a reference picture list modification process is not used to reorder the view synthesis prediction picture; and decode the current block relative to the view synthesis reference picture. ### Claim 19 (depends on 11) The apparatus of claim 11, wherein the one or more processors are further configured to synthesize a view synthesis reference picture from the inter-view reference picture only when the inter-view reference picture is included in reference picture list zero. ### Claim 20 (depends on 11) The apparatus of claim 11, wherein the one or more processors are further configured to synthesize a view synthesis reference picture from the inter-view reference picture only when the inter-view reference picture is included in reference picture list one. ### Claim 21 A method of encoding video data, the method comprising: determining whether a reference index for a current block corresponds to an inter-view reference picture; when the reference index for the current block corresponds to the inter-view reference picture, generating data indicating a view synthesis prediction (VSP) mode of the current block, wherein the VSP mode for the reference index indicates whether the current block is predicted with view synthesis prediction from the inter-view reference picture; and encoding the data indicating the VSP mode in a bitstream. ### Claim 22 (depends on 21) The method of claim 21, wherein generating the data indicating the VSP mode comprises generating a VSP flag at a block level only when the reference index for the current block corresponds to an inter-view reference picture. ### Claim 23 (depends on 22) The method of claim 22, wherein the block level is a macroblock level when the current block is a macroblock or a macroblock partition level when the current block is a macroblock partition. ### Claim 24 (depends on 21) The method of claim 21, further comprising encoding a slice header that does not include an indication of a reference index of a view synthesis reference picture for encoding the current block. ### Claim 25 (depends on 21) The method of claim 21, wherein generating the data indicating the VSP mode for the current block comprises generating the data only when the reference index for the current block corresponds to a picture in reference picture list zero. ### Claim 26 (depends on 21) The method of claim 21, wherein generating the data indicating the VSP mode for the current block comprises generating the data when the reference index for the current block corresponds to a picture in one of a first reference picture list and a second reference picture list. ### Claim 27 (depends on 21) The method of claim 21, further comprising encoding data indicating whether to perform one of the VSP mode and a second VSP mode, wherein performing the second VSP mode comprises determining a view synthesis reference picture based on a reference picture index of the view synthesis reference picture. ### Claim 28 (depends on 21) The method of claim 21, further comprising: determining a view synthesis reference picture from the inter-view reference picture; adding the view synthesis prediction picture to a reference picture list, wherein a reference picture list modification process is not used to reorder the view synthesis prediction picture; and encoding the current block relative to the view synthesis reference picture. ### Claim 29 (depends on 21) The method of claim 21, further comprising synthesizing a view synthesis reference picture from the inter-view reference picture only when the inter-view reference picture is included in reference picture list zero. ### Claim 30 (depends on 21) The method of claim 21, further comprising synthesizing a view synthesis reference picture from the inter-view reference picture only when the inter-view reference picture is included in reference picture list one. ### Claim 31 An apparatus for encoding video data, the apparatus comprising: a memory storing video data including a current block; and one or more processors configured to: determine whether a reference index for a current block corresponds to an inter-view reference picture; when the reference index for the current block corresponds to the inter-view reference picture, generate data indicating a view synthesis prediction (VSP) mode of the current block, wherein the VSP mode for the reference index indicates whether the current block is predicted with view synthesis prediction from the inter-view reference picture; and encode the data indicating the VSP mode in a bitstream. ### Claim 32 (depends on 31) The apparatus of claim 31, wherein to generate the data indicating the VSP mode, the one or more processors are configured to generate a VSP flag at a block level only when the reference index for the current block corresponds to an inter-view reference picture. ### Claim 33 (depends on 32) The apparatus of claim 32, wherein the block level is a macroblock level when the current block is a macroblock or a macroblock partition level when the current block is a macroblock partition. ### Claim 34 (depends on 31) The apparatus of claim 31, wherein the one or more processors are further configured to encode a slice header that does not include an indication of a reference index of a view synthesis reference picture for encoding the current block. ### Claim 35 (depends on 31) The apparatus of claim 31, wherein the one or more processors are configured to generate the data indicating the VSP mode for the current block only when the reference index for the current block corresponds to a picture in reference picture list zero. ### Claim 36 (depends on 31) The apparatus of claim 31, wherein the one or more processors are configured to generate the data indicating the VSP mode for the current block when the reference index for the current block corresponds to a picture in one of a first reference picture list and a second reference picture list. ### Claim 37 (depends on 31) The apparatus of claim 31, wherein the one or more processors are further configured to encode data indicating whether to perform one of the VSP mode and a second VSP mode, wherein to perform the second VSP mode, the one or more processors are configured to determine a view synthesis reference picture based on a reference picture index of the view synthesis reference picture. ### Claim 38 (depends on 31) The apparatus of claim 31, wherein the one or more processors are further configured to: determine a view synthesis reference picture from the inter-view reference picture; add the view synthesis prediction picture to a reference picture list, wherein a reference picture list modification process is not used to reorder the view synthesis prediction picture; and encode the current block relative to the view synthesis reference picture. ### Claim 39 (depends on 31) The apparatus of claim 31, wherein the one or more processors are further configured to synthesize a view synthesis reference picture from the inter-view reference picture only when the inter-view reference picture is included in reference picture list zero. ### Claim 40 (depends on 31) The apparatus of claim 31, wherein the one or more processors are further configured to synthesize a view synthesis reference picture from the inter-view reference picture only when the inter-view reference picture is included in reference picture list one. ### Claim 41 A non-transitory computer-readable medium having instructions stored thereon that, when executed, cause one or more processors to: determine whether a reference index for a current block corresponds to an inter-view reference picture; and when the reference index for the current block corresponds to the inter-view reference picture, code data indicating a view synthesis prediction (VSP) mode of the current block, wherein the VSP mode for the reference index indicates whether the current block is predicted with view synthesis prediction from the inter-view reference picture. ### Claim 42 (depends on 41) The non-transitory computer-readable medium of claim 41, wherein coding the data indicating the VSP mode comprises coding a VSP flag at a block level only when the reference index for the current block corresponds to an inter-view reference picture. ### Claim 43 (depends on 42) The non-transitory computer-readable medium of claim 42, wherein the block level is a macroblock level when the current block is a macroblock or a macroblock partition level when the current block is a macroblock partition. ### Claim 44 An apparatus for coding video data, the apparatus comprising: means for determining whether a reference index for a current block corresponds to an inter-view reference picture; and when the reference index for the current block corresponds to the inter-view reference picture, means for coding data indicating a view synthesis prediction (VSP) mode of the current block, wherein the VSP mode for the reference index indicates whether the current block is predicted with view synthesis prediction from the inter-view reference picture. ### Claim 45 (depends on 44) The apparatus of claim 44, wherein the means for coding the data indicating the VSP mode comprises means for coding a VSP flag at a block level only when the reference index for the current block corresponds to an inter-view reference picture. ### Claim 46 (depends on 45) The apparatus of claim 45, wherein the block level is a macroblock level when the current block is a macroblock or a macroblock partition level when the current block is a macroblock partition.