Back to results
US 9,544,612 B2Granted
Prediction parameter inheritance for 3D video coding
AssigneeIntel Corporation
InventorsZhipin Deng, Yi-Jen Chiu, Lidong Xu, Wenhao Zhang, Yu Han, Xiaoxia Cai
Life of this patent
Estimating the term…
Abstract
A three-dimensional (3D) video codec encodes multiple views of a 3D video, each including texture and depth components. The encoders of the codec encode video blocks of their respective views based on a set of prediction parameters, such as quad-tree split flags, prediction modes, partition sizes, motion fields, inter directions, reference indices, luma intra modes, and chroma intra modes. The prediction parameters may be inherited across different views and different ones of the texture and depth components.
Claims35
A non-transitory computer readable medium encoded with a computer program including instructions to cause a processor to:
- encode a video block from each of a texture component of a first view of multiple views of multi-view video, a depth component of the first view, a texture component of a second view of the multiple views, and a depth component of the second view,
- wherein the instructions to cause the processor to encode each video block include instructions to cause the processor to:
- determine whether to encode each video block based on inherited prediction parameters;
- encode the respective video block based on inherited prediction parameters if it is determined to encode based on inherited prediction parameters;
- encode the respective video block based on prediction parameters that are not inherited if it is determined not to encode based on inherited prediction parameters,
- wherein to encode the respective video block based on inherited prediction parameters or prediction parameters that are not inherited, the instructions cause the processor to predict a predicted video block for each respective video block based on a selectable one of
- prediction parameters inherited from a selectable one of the other video blocks, wherein the inherited prediction parameters comprise inter-prediction modes if the one of the other video blocks includes coding blocks encoded based on the inter-prediction modes, intra-prediction modes if the one of the other video blocks includes coding blocks encoded based on the intra-prediction modes, and a combination of inter and intra prediction modes if the one of other video blocks includes coding blocks encoded based on a combination of the inter and intra modes, or
- prediction parameters that are not inherited from one of the other video blocks,
- generate an encoded bitstream comprising encoded video blocks of the texture and the depth components in each of the multiple views;
- and
- embed into the encoded bitstream a prediction parameter inheritance (PPI) syntax associated with each of the encoded video blocks that was encoded based on inherited prediction parameters, the PPI syntax including a PPI flag indicating that the encoded video block was encoded based on inherited prediction parameters and information from which the one of the other video blocks from which the prediction parameters were inherited is determinable, wherein the encoded bitstream comprises the inherited prediction parameters.
8 more elements
A apparatus, comprising:
- an encoder to encode a video block from each of a texture component of a first view of multiple views of multi-view video, a depth component of the first view, a texture component of a second view of the multiple views, and a depth component of the second view;
- wherein the encoder is configured to:
- determine whether to encode each video block based on inherited prediction parameters;
- encode the respective video block based on inherited prediction parameters if it is determined to encode based on inherited prediction parameters;
- encode the respective video block based on prediction parameters that are not inherited if it is determined not to encode based on inherited prediction parameters,
- wherein to encode the respective video block based on inherited prediction parameters or prediction parameters that are not inherited, the encoder is configured to predict a predicted video block for each respective video block based on a selectable one of
- prediction parameters inherited from a selectable one of the other video blocks, wherein the inherited prediction parameters comprise inter-prediction modes if the one of the other video blocks includes coding blocks encoded based on the inter-prediction modes, intra-prediction modes if the one of the other video blocks includes coding blocks encoded based on the intra-prediction modes, and a combination of inter and intra prediction modes if the one of other video blocks includes coding blocks encoded based on a combination of the inter and intra modes, or
- prediction parameters that are not inherited from one of the other video blocks,
- generate an encoded bitstream comprising encoded video blocks of the texture and the depth components in each of the multiple views;
- and
- embed into the encoded bitstream a prediction parameter inheritance (PPI) syntax associated with each of the encoded video blocks that was encoded based on inherited prediction parameters, the PPI syntax including a PPI flag indicating that the encoded video block was encoded based on inherited prediction parameters and information from which the one of the other video blocks from which the prediction parameters were inherited is determinable, wherein the encoded bitstream comprises the inherited prediction parameters.
8 more elements
A method, comprising:
- encoding a video block from each of a texture component of a first view of multiple views of multi-view video, a depth component of the first view, a texture component of a second view of the multiple views, and a depth component of the second view;
- wherein the encoding of each video block includes
- determining whether to encode each video block based on inherited prediction parameters;
- encoding the respective video block based on inherited prediction parameters if it is determined to encode based on inherited prediction parameters;
- encoding the respective video block based on prediction parameters that are not inherited if it is determined not to encode based on inherited prediction parameters,
- wherein encoding the respective video block based on inherited prediction parameters or prediction parameters that are not inherited comprises predicting a predicted vide block for each respective video block based on a selectable one of
- prediction parameters inherited from a selectable one of the other video blocks, wherein the inherited prediction parameters comprise inter-prediction modes if the one of the other video blocks includes coding blocks encoded based on the inter-prediction modes, intra-prediction modes if the one of the other video blocks includes coding blocks encoded based on the intra-prediction modes, and a combination of inter and intra prediction modes if the one of other video blocks includes coding blocks encoded based on a combination of the inter and intra modes, or
- prediction parameters that are not inherited from one of the other video blocks
- generating an encoded bitstream comprising encoded video blocks of the texture and the depth components in each of the multiple views;
- and
- embedding into the encoded bitstream a prediction parameter inheritance (PPI) syntax associated with each of the encoded video blocks that was encoded based on inherited prediction parameters, the PPI syntax including a PPI flag indicating that the encoded video block was encoded based on inherited prediction parameters and information from which the one of the other video blocks from which the prediction parameters were inherited is determinable, wherein the encoded bitstream comprises the inherited prediction parameters.
8 more elements
A non-transitory computer readable medium encoded with a computer program including instructions to cause a processor to:
- receive an encoded bitstream comprising an encoded video block of each of a texture component of a first view of multiple views of multi-view video, a depth component of the first view, a texture component of a second view of the multiple views, and a depth component of the second view, and a prediction parameter inheritance (PPI) syntax associated with each of the encoded video blocks that was encoded based on inherited prediction parameters, the PPI syntax including a PPI flag indicating that the encoded video block was encoded based on inherited prediction parameters and information from which the one of the other video blocks from which the prediction parameters were inherited is determinable, wherein the encoded bitstream comprises the inherited prediction parameters;
- determine whether each encoded video block was encoded based on inherited prediction parameters;
- decode the respective video block based on inherited prediction parameters if it is determined the respective video block was encoded based on inherited prediction parameters;
- decode the respective video block based on prediction parameters that are not inherited if it is determined the respective video block was not encoded based on inherited prediction parameters,
- wherein to decode the respective video block based on inherited prediction parameters or prediction parameters that are not inherited, the instructions cause the processor to predict a predicted video block for the respective encoded video block based on prediction parameters inherited from a selectable one of the other encoded video blocks indicated in the PPI syntax, if inherited prediction parameters are indicated for the respective encoded video block, wherein the inherited prediction parameters comprise inter-prediction modes if the one of the other video blocks includes coding blocks encoded based on the inter-prediction modes, intra-prediction modes if the one of the other video blocks includes coding blocks encoded based on the intra-prediction modes, and a combination of inter and intra prediction modes if the one of other video blocks includes coding blocks encoded based on a combination of the inter and intra modes, or based on prediction parameters that are not inherited from one of the other video blocks, if inherited prediction parameters are not indicated.
2 more elements
An apparatus, comprising:
- a decoder configured to:
- receive an encoded bitstream comprising an encoded video block of each of a texture component of a first view of multiple views of multi-view video, a depth component of the first view, a texture component of a second view of the multiple views, and a depth component of the second view, and a prediction parameter inheritance (PPI) syntax associated with each of the encoded video blocks that was encoded based on inherited prediction parameters, the PPI syntax including a PPI flag indicating that the encoded video block was encoded based on inherited prediction parameters and information from which the one of the other video blocks from which the prediction parameters were inherited is determinable, wherein the encoded bitstream comprises the inherited prediction parameters;
- determine whether each encoded video block was encoded based on inherited prediction parameters;
- decode the respective video block based on inherited prediction parameters if it is determined the respective video block was encoded based on inherited prediction parameters;
- decode the respective video block based on prediction parameters that are not inherited if it is determined the respective video block was not encoded based on inherited prediction parameters,
- wherein to decode the respective video block based on inherited prediction parameters or prediction parameters that are not inherited, the decoder is configured to predict a predicted video block for the respective encoded video block based on prediction parameters inherited from a selectable one of the other encoded video blocks indicated in the PPI syntax, if inherited prediction parameters are indicated for the respective encoded video block, wherein the inherited prediction parameters comprise inter-prediction modes if the one of the other video blocks includes coding blocks encoded based on the inter-prediction modes, intra-prediction modes if the one of the other video blocks includes coding blocks encoded based on the intra-prediction modes, and a combination of inter and intra prediction modes if the one of other video blocks includes coding blocks encoded based on a combination of the inter and intra modes, or based on prediction parameters that are not inherited from one of the other video blocks, if inherited prediction parameters are not indicated.
3 more elements
A method, comprising:
- receiving an encoded bitstream comprising an encoded video block of each of a texture component of a first view of multiple views of multi-view video, a depth component of the first view, a texture component of a second view of the multiple views, and a depth component of the second view, and a prediction parameter inheritance (PPI) syntax associated with each of the encoded video blocks that was encoded based on inherited prediction parameters, the PPI syntax including a PPI flag indicating that the encoded video block was encoded based on inherited prediction parameters and information from which the one of the other video blocks from which the prediction parameters were inherited is determinable, wherein the encoded bitstream comprises the inherited prediction parameters;
- determining whether each encoded video block was encoded based on inherited prediction parameters;
- decoding the respective video block based on inherited prediction parameters if it is determined the respective video block was encoded based on inherited prediction parameters;
- decoding the respective video block based on prediction parameters that are not inherited if it is determined the respective video block was not encoded based on inherited prediction parameters,
- wherein decoding the respective video block based on inherited prediction parameters or prediction parameters that are not inherited comprises predicting a predicted video block for the respective encoded video block based on prediction parameters inherited from a selectable one of the other encoded video blocks indicated in the PPI syntax, if inherited prediction parameters are indicated for the respective encoded video block, wherein the inherited prediction parameters comprise inter-prediction modes if the one of the other video blocks includes coding blocks encoded based on the inter-prediction modes, intra-prediction modes if the one of the other video blocks includes coding blocks encoded based on the intra-prediction modes, and a combination of inter and intra prediction modes if the one of other video blocks includes coding blocks encoded based on a combination of the inter and intra modes, or based on prediction parameters that are not inherited from one of the other video blocks, if inherited prediction parameters are not indicated.
2 more elements
Dependencies are inferred from the claim text.