# US 2018/0027258 A1 · 3d-video codec supporting inter-component prediction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0027258 A1
- Document ID: US20180027258A1
- Status: Published application
- Kind: A1
- Application number: 15/669,063
- Filed: 2017-08-04
- Published: 2018-01-25
- Earliest claimed: 2015-02-05
- Assignees: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Applicants: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Inventors: Gerhard TECH; Karsten SUEHRING; Detlev MARPE; Thomas WIEGAND
- Web page: https://patentgrep.com/patent/US20180027258A1

## CPC

- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/157: Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N 19/187: the unit being a scalable video layer
- H04N 19/54: using feature points or meshes
- H04N 19/543: using regions
- H04N 19/58: Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one (H04N19/23 takes precedence)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

3D video coding/decoding supporting inter-component prediction is made operatable with respect to a broader range of settings with respect to accompanying individual views with depth and deactivation/enablement of inter-component prediction, by using one or more flags in the data stream to control the enablement/disablement of the availability of inter-component prediction for coding units of a current picture.

## Claims

### Claim 1

3D video decoder comprising
a video decoding core configured to decode a sequence of layers of a video from a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video decoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view and depth-to-texture prediction from layers representing depth,
an inter-component prediction switch configured to
read a first parameter set from the data stream, the first parameter set relating to a temporal portion of the video relating to a timestamp of a current picture, and derive therefrom, for a current picture of a current layer which represents texture, a texture reference layer set of layers representing texture,
read a second parameter set from the data stream, the second parameter set relating to the current picture or a portion of the current picture, and derive therefrom, for coding units within the current picture or the portion of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set,
if an intersection of
a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and
a depth reference layer set of layers representing depth determined by the first parameter set, on the other hand
equals the potentially available set, then read a flag from the data stream, the flag relating to the current picture or the portion of the current picture and indicating whether the depth-to-texture prediction is enabled or disabled for the coding units within the current picture or the portion of the current picture, and
if the intersection is unequal to the potentially available set, then infer the flag relating to the coding units within the current picture or the portion of the current picture as indicating that the depth-to-texture prediction is disabled for the coding units,
wherein the video decoding core is configured to be responsive to the flag in order to, depending on the flag, apply or not apply depth-to-texture prediction for a current coding unit among the coding units within the current picture or the portion of the current picture.

### Claim 2 (depends on 1)

3D video decoder according to claim 1, wherein the flag and the second parameter set relate to a slice of the current picture.

### Claim 3 (depends on 1)

3D video decoder according to claim 1, wherein each layer of the selected texture reference layer set comprises a picture at the current picture's time stamp.

### Claim 4 (depends on 1)

3D video decoder according to claim 1, wherein the video decoding core is configured to support temporal prediction and/or spatial prediction in intra-layer prediction.

### Claim 5 (depends on 1)

3D video decoder according to claim 1, wherein the video decoding core is configured to, in applying depth-to-texture prediction for the current coding unit, derive, from a in terms of disparity corresponding portion of a depth reference picture of the intersection,
a partition of the current coding unit into more than one partition for separate prediction, and/or
a motion vector for decoding the current coding unit, and/or
a disparity vector for decoding the current coding unit.

### Claim 6 (depends on 1)

3D video decoder according to claim 1, wherein the video decoding core is configured to
depending on the flag, derive a partition of the current coding unit into more than one partition from an in terms of disparity corresponding portion of a depth reference picture of the intersection or dividing the current coding unit into more than one partition of equal size and shape, and/or
depending on the flag, predict a motion vector for decoding the current coding unit from a motion vector candidate list comprising or excluding a motion vector derived from a in terms of disparity corresponding portion of a depth reference picture of the intersection, and/or
depending on the flag, predict a disparity vector for decoding the current coding unit from a disparity vector candidate list comprising or excluding a disparity vector derived from a in terms of disparity corresponding portion of a depth reference picture of the intersection.

### Claim 7 (depends on 1)

3D video decoder according to claim 1, wherein the video decoding core is configured to applying depth-to-texture prediction for the current coding unit depending on the flag by
if the flag indicates that the depth-to-texture prediction is enabled for the current coding unit, reading a syntax element specific for the current coding unit from the data stream, the syntax element signaling whether the depth-to-texture prediction is to be applied to the current coding unit or not,
if the flag indicates the depth-to-texture prediction is disabled for the current coding unit, skipping reading the syntax element from the data stream, and
apply the depth-to-texture prediction for the current coding unit the flag indicates that the depth-to-texture prediction is enabled for the current coding unit and if the syntax element indicates that the depth-to-texture prediction is to be applied to the current coding unit.

### Claim 8 (depends on 1)

3D video decoder according to claim 1, wherein the video decoding core is configured to, in inter-view texture prediction from layers representing texture of a different view, perform disparity compensated prediction.

### Claim 9 (depends on 1)

3D video decoder according to claim 1, wherein the first parameter set comprises a scope in the data stream so that the temporal portion of the video the first parameter set encompasses the video as a whole or a sequence of pictures.

### Claim 10 (depends on 1)

3D video decoder according to claim 1, wherein the inter-component prediction switch is configured to read the flag from a slice header of a slice of the current picture.

### Claim 11 (depends on 1)

3D video decoder according to claim 1, wherein the inter-component prediction switch is configured to act commonly for two hypotheses in case of the current picture being a bi-predicted picture.

### Claim 12 (depends on 1)

3D video decoder according to claim 1, configured to, if the depth-to-texture prediction is enabled for the current coding unit, detect picture loss if any of the pictures of the intersection not being coded in the data stream.

### Claim 13 (depends on 1)

3D video decoder according to claim 1, further configured to disable, irrespective of the inter-component prediction switch, the depth-to-texture prediction of the current coding unit responsive to a further flag in the data stream.

### Claim 14 (depends on 1)

3D video decoder according to claim 1, wherein the inter-component prediction switch is configured to suppress reading the flag in case of the depth-to-texture prediction of the current coding unit being disabled by a further flag in the data stream.

### Claim 15 (depends on 1)

3D video decoder according to claim 1, wherein the video decoding core also supports texture-to-depth prediction enabled and disabled by the inter-component prediction switch.

### Claim 16 (depends on 1)

3D video decoder according to claim 1, wherein the inter-component switch is configured to use also a temporal ID of the current picture, corresponding to the timestamp of the current picture, in order to derive the texture reference layer set of layers representing texture from the first parameter set.

### Claim 17

3D video encoder comprising
a video encoding core configured to encode a sequence of layers of a video into a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video decoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view and depth-to-texture prediction from layers representing depth,
an inter-component prediction switch configured to
insert a first parameter set into the data stream, the first parameter set relating to a temporal portion of the video relating to a timestamp of a current picture, and indicating, for a current picture of a current layer which represents texture, a texture reference layer set of layers representing texture and a depth reference layer set of layers representing depth,
insert a second parameter set into the data stream, the second parameter set relating to the current picture or a portion of the current picture, and indicating, for coding units within the current picture or a portion of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set,
if an intersection of a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and the depth reference layer set, on the other hand, equals the potentially available set, then deciding whether the depth-to-texture prediction is enabled or disabled for the current picture or the portion of the picture and inserting a flag into the data stream, the flag relating to the current picture or portion of the current picture and indicating whether the depth-to-texture prediction is enabled or disabled for the coding units within the current picture or the portion of the current picture, and
if the intersection is unequal to the potentially available set, suppressing inserting the flag relating to the coding units within the current picture or the portion of the current picture and disabling the depth-to-texture prediction for the coding units,
wherein the video encoding core is configured to, depending on the depth-to-texture prediction being enabled or disabled for the current coding unit, apply or not apply depth-to-texture prediction for a current coding unit among the coding units within the current picture or the portion of the current picture.

### Claim 18 (depends on 17)

3D video encoder according to claim 17, wherein the flag and the second parameter set relate to a slice of the current picture.

### Claim 19 (depends on 17)

3D video encoder according to claim 17, wherein each layer of the selected texture reference layer set comprises a picture at the current picture's time stamp.

### Claim 20 (depends on 17)

3D video encoder according to claim 17, wherein the video encoding core is configured to support temporal prediction and/or spatial prediction in intra-layer prediction.

### Claim 21 (depends on 17)

3D video encoder according to claim 17, wherein the video encoding core is configured to, in applying depth-to-texture prediction for the current coding unit, derive, from a in terms of disparity corresponding portion of a depth reference picture of the intersection,
a partition of the current coding unit into more than one partition separately predicted, and/or
a motion vector for decoding the current coding unit, and/or
a disparity vector for decoding the current coding unit.

### Claim 22 (depends on 17)

3D video encoder according to claim 17, wherein the video encoding core is configured to
depending on the flag, derive a partition of the current coding unit into more than one partition from a in terms of disparity corresponding portion of a depth reference picture of the intersection or dividing the current coding unit into more than one partition of equal size and shape, and/or
depending on the flag, predict a motion vector for decoding the current coding unit from a motion vector candidate list comprising or excluding a motion vector derived from a in terms of disparity corresponding portion of a depth reference picture of the intersection, and/or
depending on the flag, predict a disparity vector for decoding the current coding unit from a disparity vector candidate list comprising or excluding a disparity vector derived from a in terms of disparity corresponding portion of a depth reference picture of the intersection.

### Claim 23 (depends on 17)

3D video encoder according to claim 17, wherein the video encoding core is configured to apply depth-to-texture prediction for the current coding unit depending on the flag by
if the depth-to-texture prediction is enabled for the current coding unit, decoding whether the depth-to-texture prediction is to be applied to the current coding unit or not, and inserting a syntax element specific for the current coding unit into the data stream, the syntax element signaling whether the depth-to-texture prediction is to be applied to the current coding unit or not,
if the depth-to-texture prediction is disabled for the current coding unit, skipping inserting the syntax element into the data stream, and
apply the depth-to-texture prediction for the current coding unit if the depth-to-texture prediction is enabled for the current coding unit and the depth-to-texture prediction is to be applied to the current coding unit.

### Claim 24 (depends on 17)

3D video encoder according to claim 17, wherein the video encoding core is configured to, in inter-view texture prediction from layers representing texture of a different view, perform disparity compensated prediction.

### Claim 25 (depends on 17)

3D video encoder according to claim 17, wherein the first parameter set comprises a scope in the data stream so that the temporal portion of the video the first parameter set encompasses the video as a whole or a sequence of pictures.

### Claim 26 (depends on 17)

3D video encoder according to claim 17, wherein the inter-component prediction switch is configured to insert the flag into a slice header of a slice of the current picture.

### Claim 27 (depends on 17)

3D video encoder according to claim 17, wherein the inter-component prediction switch is configured to read the flag specifically for the current picture.

### Claim 28 (depends on 17)

3D video encoder according to claim 17, wherein the inter-component prediction switch is configured to act commonly for two hypotheses in case of the current picture being a bi-predicted picture.

### Claim 29 (depends on 17)

3D video encoder according to claim 17, further configured to disable, irrespective of the inter-component prediction switch, the depth-to-texture prediction of the current coding unit and signal the disablement by way of a further flag in the data stream.

### Claim 30 (depends on 17)

3D video encoder according to claim 17, wherein the inter-component prediction switch is configured to suppress reading the flag in case of the depth-to-texture prediction of the current coding unit being disabled by a further flag in the data stream.

### Claim 31 (depends on 17)

3D video encoder according to claim 17, wherein the video decoding core also supports texture-to-depth prediction enabled and disabled by the inter-component prediction switch.

### Claim 32 (depends on 17)

3D video encoder according to claim 17, wherein the inter-component switch is configured so that the first parameter set indicates the texture reference layer set of layers representing texture in a manner involving a temporal ID of the current picture, corresponding to the timestamp of the current picture, in order to derive.

### Claim 33

3D video decoder comprising
a video decoding core configured to decode a sequence of layers of a video from a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video decoding core supporting, for a layer representing depth of a current view, prediction from layers representing depth of a different view and texture-to-depth prediction from a layer representing texture,
an inter-component prediction switch configured to
read a first parameter set from the data stream, the first parameter set relating to a temporal portion of the video relating to a timestamp of a current picture of the layer representing depth of the current view,
if an intersection of a potentially available set of one or more layers representing texture of one or more views the depth of which is represented by the layer representing depth of the current view, on the one hand and a texture reference layer set of layers representing texture determined by the first parameter set, on the other hand equals the potentially available set, read a flag from the data stream, the flag relating to the current picture or a portion of the current picture and indicating whether the texture-to-depth prediction is enabled or disabled for the coding units within the current picture or the portion of the current picture,
if the intersection is unequal to the potentially available set, then infer the flag relating to the coding units within the current picture or the portion of the current picture as indicating that the texture-to-depth prediction is disabled for the coding units,
wherein the video decoding core is configured to be responsive to the flag in order to, depending on the flag, apply or not apply texture-to-depth prediction for a current coding unit among the coding units within the current picture or the portion of the current picture.

### Claim 34 (depends on 1, 33)

3D video decoder according to claim 33, further configured according to claim 1.

### Claim 35

3D video encoder comprising
a video encoding core configured to encode a sequence of layers of a video into a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video decoding core supporting, for layers representing depth of a current view, prediction from layers representing depth of a different view and texture-to-depth prediction from a layer representing depth of the current layer,
an inter-component prediction switch configured to
insert a first parameter set into the data stream, the first parameter set relating to a temporal portion of the video relating to a timestamp of a current picture of the layer representing depth of the current view, and indicating, for the current picture, a texture reference layer set of layers representing texture,
if an intersection of a potentially available set of one or more layers representing texture of one or more views the depth of which is represented by the layer representing depth of the current view, on the one hand and the texture reference layer set, on the other hand equals the potentially available set, deciding whether the texture-to-depth prediction is enabled or disabled for the coding units within the current picture or a portion of the current picture, and inserting a flag into the data stream, the flag relating to the current picture or portion of the current picture and indicating whether the texture-to-depth prediction is enabled or disabled for the coding units within the current picture or the portion of the current picture, and
wherein the video encoding core is configured to, depending on the depth-to-texture prediction being enabled or disabled for the current coding unit, apply or not apply texture-to-depth prediction for a current coding unit among the coding units within the current picture or the portion of the current picture.

### Claim 36

Method for 3D video decoding, comprising
decoding, performed by a video decoding core , a sequence of layers of a video from a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video decoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view,
reading a first parameter set from the data stream, the first parameter set relating to a temporal portion of the video relating to a timestamp of a current picture, and derive therefrom, for a current picture of a current layer which represents texture, a texture reference layer set of layers representing texture and a depth reference layer set of layers representing depth,
reading a second parameter set from the data stream, the second parameter set relating to the current picture or a portion of the current picture, and derive therefrom, for coding units within the current picture or the portion of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set, each layer of the selected texture reference layer set,
if an intersection of
a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and a depth reference layer set of layers representing depth determined by the first parameter set, on the other hand
equals the potentially available set, then reading a flag from the data stream, the flag relating to the current picture or the portion of the current picture and indicating whether the depth-to-texture prediction is enabled or disabled for the coding units within the current picture or the portion of the current picture, and
if the intersection is unequal to the potentially available set, then inferring the flag relating to the coding units within the current picture or the portion of the current picture as indicating that the depth-to-texture prediction is disabled for the coding units,
wherein the video decoding core, depending on the flag, applies or not applies depth-to-texture prediction for a current coding unit among the coding units within the current picture or the portion of the current picture.

### Claim 37

Method for 3D video encoding, comprising
encoding, performed by a video encoding core, a sequence of layers of a video into a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video decoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view and depth-to-texture prediction from layers representing depth,
inserting a first parameter set into the data stream, the first parameter set relating to a temporal portion of the video relating to a timestamp of a current picture, and indicating, for a current picture of a current layer which represents texture, a texture reference layer set of layers representing texture and a depth reference layer set of layers relating to depth,
inserting a second parameter set into the data stream, the second parameter set relating to the current picture or a portion of the current picture, and indicating, for coding units within the current picture or a portion of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set,
if an intersection of a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and the depth reference layer set, on the other hand, equals the potentially available set, then deciding whether the depth-to-texture prediction is enabled or disabled for the current picture or the portion of the picture and inserting a flag into the data stream, the flag relating to the current picture or portion of the current picture and indicating whether the depth-to-texture prediction is enabled or disabled for the coding units within the current picture or the portion of the current picture, and
if the intersection is unequal to the potentially available set, suppressing inserting the flag relating to the coding units within the current picture or the portion of the current picture and disabling the depth-to-texture prediction for the coding units,
wherein the video encoding core, depending on the depth-to-texture prediction being enabled or disabled for the current coding unit, applies or not applies depth-to-texture prediction for a current coding unit among the coding units within the current picture or the portion of the current picture.

### Claim 38

A non-transitory digital storage medium having a computer program stored thereon to perform the method for 3D video decoding, the method comprising
decoding, performed by a video decoding core, a sequence of layers of a video from a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video decoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view,
reading a first parameter set from the data stream, the first parameter set relating to a temporal portion of the video relating to a timestamp of a current picture, and derive therefrom, for a current picture of a current layer which represents texture, a texture reference layer set of layers representing texture and a depth reference layer set of layers representing depth,
reading a second parameter set from the data stream, the second parameter set relating to the current picture or a portion of the current picture, and derive therefrom, for coding units within the current picture or the portion of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set, each layer of the selected texture reference layer set,
if an intersection of
a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and a depth reference layer set of layers representing depth determined by the first parameter set, on the other hand
equals the potentially available set, then reading a flag from the data stream, the flag relating to the current picture or the portion of the current picture and indicating whether the depth-to-texture prediction is enabled or disabled for the coding units within the current picture or the portion of the current picture, and
if the intersection is unequal to the potentially available set, then inferring the flag relating to the coding units within the current picture or the portion of the current picture as indicating that the depth-to-texture prediction is disabled for the coding units,
wherein the video decoding core, depending on the flag, applies or not applies depth-to-texture prediction for a current coding unit among the coding units within the current picture or the portion of the current picture,
when said computer program is run by a computer.

### Claim 39

A non-transitory digital storage medium having a computer program stored thereon to perform the method for 3D video encoding, the method comprising
encoding, performed by a video encoding core, a sequence of layers of a video into a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video decoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view and depth-to-texture prediction from layers representing depth,
inserting a first parameter set into the data stream, the first parameter set relating to a temporal portion of the video relating to a timestamp of a current picture, and indicating, for a current picture of a current layer which represents texture, a texture reference layer set of layers representing texture and a depth reference layer set of layers relating to depth,
inserting a second parameter set into the data stream, the second parameter set relating to the current picture or a portion of the current picture, and indicating, for coding units within the current picture or a portion of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set,
if an intersection of a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and the depth reference layer set, on the other hand, equals the potentially available set, then deciding whether the depth-to-texture prediction is enabled or disabled for the current picture or the portion of the picture and inserting a flag into the data stream, the flag relating to the current picture or portion of the current picture and indicating whether the depth-to-texture prediction is enabled or disabled for the coding units within the current picture or the portion of the current picture, and
if the intersection is unequal to the potentially available set, suppressing inserting the flag relating to the coding units within the current picture or the portion of the current picture and disabling the depth-to-texture prediction for the coding units,
wherein the video encoding core, depending on the depth-to-texture prediction being enabled or disabled for the current coding unit, applies or not applies depth-to-texture prediction for a current coding unit among the coding units within the current picture or the portion of the current picture,
when said computer program is run by a computer.

### Claim 40

Digital storage medium having stored thereon a data stream generated by a method for 3D video encoding, the method comprising
encoding, performed by a video encoding core, a sequence of layers of a video into a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video decoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view and depth-to-texture prediction from layers representing depth,
inserting a first parameter set into the data stream, the first parameter set relating to a temporal portion of the video relating to a timestamp of a current picture, and indicating, for a current picture of a current layer which represents texture, a texture reference layer set of layers representing texture and a depth reference layer set of layers relating to depth,
inserting a second parameter set into the data stream, the second parameter set relating to the current picture or a portion of the current picture, and indicating, for coding units within the current picture or a portion of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set,
if an intersection of a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and the depth reference layer set, on the other hand, equals the potentially available set, then deciding whether the depth-to-texture prediction is enabled or disabled for the current picture or the portion of the picture and inserting a flag into the data stream, the flag relating to the current picture or portion of the current picture and indicating whether the depth-to-texture prediction is enabled or disabled for the coding units within the current picture or the portion of the current picture, and
if the intersection is unequal to the potentially available set, suppressing inserting the flag relating to the coding units within the current picture or the portion of the current picture and disabling the depth-to-texture prediction for the coding units,
wherein the video encoding core, depending on the depth-to-texture prediction being enabled or disabled for the current coding unit, applies or not applies depth-to-texture prediction for a current coding unit among the coding units within the current picture or the portion of the current picture.

### Claim 41

3D video decoder comprising
a video decoding core configured to decode a sequence of layers of a video from a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video decoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view and depth-to-texture prediction from layers representing depth,
an inter-component prediction switch configured to
read a first parameter set from the data stream, the first parameter set relating to a temporal portion of the video, and derive therefrom, for a current picture of a current layer which represents texture, the timestamp of which is comprised within the temporal portion, a texture reference layer set of layers representing texture,
read a second parameter set from the data stream, the second parameter set relating to a portion of the current picture or a portion of the current picture, and derive therefrom, for a current coding unit of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set, each layer of the selected texture reference layer set comprising a picture at the current picture's timestamp, and, on the basis of the selected texture reference layer set, an intersection of a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and a depth reference layer set of layers representing depth determined by the first parameter set, on the other hand,
read, per layer of the intersection, a flag from the data stream, the flag relating, at least, to the current coding unit and indicating whether the depth-to-texture prediction using the respective layer as depth-to-texture prediction reference is enabled or disabled for the current coding unit, and
wherein the video decoding core is configured to be responsive to the flags for the layers of the intersection in order to, depending on the flags, apply or not apply depth-to-texture prediction using one or more of the layers of the intersection as depth-to-texture prediction reference for the current coding unit.

### Claim 42

3D video encoder comprising
a video encoding core configured to encode a sequence of layers of a video into a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video encoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view and depth-to-texture prediction from layers representing depth,
an inter-component prediction switch configured to
insert a first parameter set into the data stream, the first parameter set relating to a temporal portion of the video, and indicating, for a current picture of a current layer which represents texture, the timestamp of which is comprised within the temporal portion, a texture reference layer set of layers representing texture and a depth reference layer set of layers relating to depth,
insert a second parameter set from the data stream, the second parameter set relating to a portion of the current picture or a portion of the current picture, and indicating, for a current coding unit of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set, each layer of the selected texture reference layer set comprising a picture at the current picture's timestamp,
derive an intersection of a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and the depth reference layer set, on the other hand, insert, per layer of the intersection, a flag from the data stream, the flag relating, at least, to the current coding unit and indicating whether the depth-to-texture prediction using the respective layer as depth-to-texture prediction reference is enabled or disabled for the current coding unit, and
wherein the video encoding core is configured to, depending on whether the depth-to-texture prediction using the layers of the intersection as depth-to-texture prediction reference is enabled or disabled for the current coding unit, apply or not apply depth-to-texture prediction using the layers of the intersection as depth-to-texture prediction reference for the current coding unit.

### Claim 43

Method for 3D video decoding, comprising
decoding, performed by a video decoding core, a sequence of layers of a video from a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video decoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view and depth-to-texture prediction from layers representing depth,
reading a first parameter set from the data stream, the first parameter set relating to a temporal portion of the video, and derive therefrom, for a current picture of a current layer which represents texture, the timestamp of which is comprised within the temporal portion, a texture reference layer set of layers representing texture and a depth reference layer set of layers relating to depth,
reading a second parameter set from the data stream, the second parameter set relating to a portion of the current picture or a portion of the current picture, and derive therefrom, for a current coding unit of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set, each layer of the selected texture reference layer set comprising a picture at the current picture's timestamp, and, on the basis of the selected texture reference layer set, an intersection of a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and the depth reference layer set, on the other hand,
reading, per layer of the intersection, a flag from the data stream, the flag relating, at least, to the current coding unit and indicating whether the depth-to-texture prediction using the respective layer as depth-to-texture prediction reference is enabled or disabled for the current coding unit, and
wherein the video decoding core depending on the flags for the layers of the intersection applies or not applies depth-to-texture prediction using one or more of the layers of the intersection as depth-to-texture prediction reference for the current coding unit.

### Claim 44

Method for 3D video encoding, comprising
Encoding, performed by a video encoding core, a sequence of layers of a video into a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video encoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view and depth-to-texture prediction from layers representing depth,
inserting a first parameter set into the data stream, the first parameter set relating to a temporal portion of the video, and indicating, for a current picture of a current layer which represents texture, the timestamp of which is comprised within the temporal portion, a texture reference layer set of layers representing texture and a depth reference layer set of layers relating to depth,
inserting a second parameter set from the data stream, the second parameter set relating to a portion of the current picture or a portion of the current picture, and indicating, for a current coding unit of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set, each layer of the selected texture reference layer set comprising a picture at the current picture's timestamp,
deriving an intersection of a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and the depth reference layer set, on the other hand,
inserting, per layer of the intersection, a flag from the data stream, the flag relating, at least, to the current coding unit and indicating whether the depth-to-texture prediction using the respective layer as depth-to-texture prediction reference is enabled or disabled for the current coding unit, and
wherein the video encoding core, depending on whether the depth-to-texture prediction using the layers of the intersection as depth-to-texture prediction reference is enabled or disabled for the current coding unit, applies or not applies depth-to-texture prediction using the layers of the intersection as depth-to-texture prediction reference for the current coding unit.

### Claim 45

A non-transitory digital storage medium having a computer program stored thereon to perform the method for 3D video decoding, the method comprising
decoding, performed by a video decoding core, a sequence of layers of a video from a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video decoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view and depth-to-texture prediction from layers representing depth,
reading a first parameter set from the data stream, the first parameter set relating to a temporal portion of the video, and derive therefrom, for a current picture of a current layer which represents texture, the timestamp of which is comprised within the temporal portion, a texture reference layer set of layers representing texture and a depth reference layer set of layers relating to depth,
reading a second parameter set from the data stream, the second parameter set relating to a portion of the current picture or a portion of the current picture, and derive therefrom, for a current coding unit of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set, each layer of the selected texture reference layer set comprising a picture at the current picture's timestamp, and, on the basis of the selected texture reference layer set, an intersection of a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and the depth reference layer set, on the other hand,
reading, per layer of the intersection, a flag from the data stream, the flag relating, at least, to the current coding unit and indicating whether the depth-to-texture prediction using the respective layer as depth-to-texture prediction reference is enabled or disabled for the current coding unit, and
wherein the video decoding core depending on the flags for the layers of the intersection applies or not applies depth-to-texture prediction using one or more of the layers of the intersection as depth-to-texture prediction reference for the current coding unit,
when said computer program is run by a computer.

### Claim 46

A non-transitory digital storage medium having a computer program stored thereon to perform the method for 3D video encoding, the method comprising
encoding, performed by a video encoding core, a sequence of layers of a video into a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video encoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view and depth-to-texture prediction from layers representing depth,
inserting a first parameter set into the data stream, the first parameter set relating to a temporal portion of the video, and indicating, for a current picture of a current layer which represents texture, the timestamp of which is comprised within the temporal portion, a texture reference layer set of layers representing texture and a depth reference layer set of layers relating to depth,
inserting a second parameter set from the data stream, the second parameter set relating to a portion of the current picture or a portion of the current picture, and indicating, for a current coding unit of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set, each layer of the selected texture reference layer set comprising a picture at the current picture's timestamp,
deriving an intersection of a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and the depth reference layer set, on the other hand,
inserting, per layer of the intersection, a flag from the data stream, the flag relating, at least, to the current coding unit and indicating whether the depth-to-texture prediction using the respective layer as depth-to-texture prediction reference is enabled or disabled for the current coding unit, and
wherein the video encoding core, depending on whether the depth-to-texture prediction using the layers of the intersection as depth-to-texture prediction reference is enabled or disabled for the current coding unit, applies or not applies depth-to-texture prediction using the layers of the intersection as depth-to-texture prediction reference for the current coding unit,
when said computer program is run by a computer.

### Claim 47

Digital storage medium having stored thereon a data stream generated by a method for 3D video encoding, the method comprising
encoding, performed by a video encoding core, a sequence of layers of a video into a data stream using intra-layer prediction, each layer representing depth or texture of a respective one of a plurality of views, the video encoding core supporting, for layers representing texture, inter-view texture prediction from layers representing texture of a different view and depth-to-texture prediction from layers representing depth,
inserting a first parameter set into the data stream, the first parameter set relating to a temporal portion of the video, and indicating, for a current picture of a current layer which represents texture, the timestamp of which is comprised within the temporal portion, a texture reference layer set of layers representing texture and a depth reference layer set of layers relating to depth,
inserting a second parameter set from the data stream, the second parameter set relating to a portion of the current picture or a portion of the current picture, and indicating, for a current coding unit of the current picture, a selected texture reference layer set of layers representing texture from the texture reference layer set, each layer of the selected texture reference layer set comprising a picture at the current picture's timestamp,
deriving an intersection of a potentially available set of layers representing depth of views the texture of which is represented by any of the selected texture reference layer set, on the one hand and the depth reference layer set, on the other hand,
inserting, per layer of the intersection, a flag from the data stream, the flag relating, at least, to the current coding unit and indicating whether the depth-to-texture prediction using the respective layer as depth-to-texture prediction reference is enabled or disabled for the current coding unit, and
wherein the video encoding core, depending on whether the depth-to-texture prediction using the layers of the intersection as depth-to-texture prediction reference is enabled or disabled for the current coding unit, applies or not applies depth-to-texture prediction using the layers of the intersection as depth-to-texture prediction reference for the current coding unit.
