# US 2023/0156203 A1 · Cluster-based dependency signaling

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0156203 A1
- Document ID: US20230156203A1
- Status: Published application
- Kind: A1
- Application number: 18/053,446
- Filed: 2022-11-08
- Published: 2023-05-18
- Earliest claimed: 2013-07-15
- Assignees: Ge Video Compression, LLC
- Applicants: GE Video Compression, LLC
- Inventors: Karsten SUEHRING; Thomas SCHIERL; Detlev MARPE; Robert SKUPIN; Yago SANCHEZ DE LA FUENTE; Gerhard TECH
- Web page: https://patentgrep.com/patent/US20230156203A1

## CPC

- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04L 69/324: in the data link layer [OSI layer 2], e.g. HDLC
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/166: concerning the amount of transmission errors, e.g. bit error rate [BER]
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/187: the unit being a scalable video layer
- H04N 19/33: in the spatial domain
- H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence)
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/50: using predictive coding (H04N19/61 takes precedence)
- H04N 19/593: involving spatial prediction techniques
- H04N 19/65: using error resilience
- H04N 19/66: involving data partitioning, i.e. separation of data into packets or partitions according to importance
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N 19/89: involving methods or arrangements for detection of transmission errors at the decoder
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

The signalization of the inter-layer dependencies between layers of a multi-layered data stream is described. A good compromise between a too intensive restriction of the potential diversity of inter-layer dependencies on the one hand and a too complex signaling of the inter-layer dependencies on the other hand has been found by describing the inter-layer dependencies by way of a first inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by a base layer-ID and a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by an extension layer-ID, the base layer ID and extension layer ID indexing the layers the portions of the multi-layer data stream are associated with. In accordance with this concept, emphasis may be shifted between increased diversity of the signalizable inter-layer dependencies on the one hand and reduced side-information overhead for signaling the inter-layer dependencies on the other hand.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A device configured to process a multi-layered data stream into which a video is coded at different layers, corresponding to different levels of information amount, using inter-layer prediction, the multi-layer data stream comprising a plurality of packets, each of which is associated with one of the different layers, each layer being indexed by a base layer ID or a base layer ID and an extension layer ID, the device configured to:
read, from the multi-layered data stream,
a first inter-dependency syntax structure indicating interdependencies between pairs of different values representable by the base layer-ID, and
a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by the extension layer-ID, and
construct, based on the first and second inter-dependency syntax structures, an inter-layer dependency description revealing possible inter-layer prediction dependencies between the different layers.

### Claim 22 (depends on 21)

The device according to claim 21, wherein the device is configured to read a plurality of instantiations of the second inter-dependency structure from the multi-layer data stream, namely for different pairs (j,k) of values 0<k≤j≤n<N representable by the base layer-ID, with N being the number of values representable by the base layer-ID, by
reading, or suppressing reading, the second inter-dependency structure from the multi-layer data stream for pair (j,k) conditionally depending on the first inter-dependency syntax structure indicating a presence or non-presence of interdependency between pair (j,k),
wherein the instantiation of the second inter-dependency structure read for a pair (j,k) with j=k, indicates which layers among those comprising base layer-ID j are inter-layer prediction dependent on other layers among those comprising base layer-ID j, and the instantiation of the second inter-dependency structure read for pair (j,k), with k<j indicates which layers among those comprising base layer-ID j are inter-layer prediction dependent on layers among those comprising base layer-ID k.

### Claim 23 (depends on 21)

The device according to claim 21, wherein the device is configured to:
read one instantiation of the second inter-dependency structure from the multi-layer data stream, the one instantiation of the second inter-dependency structure indicating, with N being the number of values representable by the base layer-ID, either
commonly for each value 0<i≤n<N representable by the base layer-ID, which layers among those comprising base layer-ID i are inter-layer prediction dependent on other layers among those comprising base layer-ID i, or
commonly for each of a set of pairs (j,k) with 0<k<j≤n<N, which layers among those comprising base layer-ID j are inter-layer prediction dependent on layers among those comprising base layer-ID k, respectively.

### Claim 24 (depends on 21)

The device according to claim 21, wherein the device is configured to
read instantiations of the second inter-dependency structure from the multi-layer data stream, along with, for each instantiation of the second inter-dependency structure, an association syntax structure which associates the respective instantiation of the second inter-dependency structure with a respective subset of pairs (j,k) of values 0<k≤j≤n<N representable by the base layer-ID, with N being the number of values representable by the base layer-ID.

### Claim 25 (depends on 24)

The device according to claim 24, wherein the association syntax structure comprises a flag for each pair (j,k) and the device is configured to parse the association syntax structure with skipping pairs (j,k) of values 0<k≤j≤n<N for which the first inter-dependency syntax structure indicates the non-presence of interdependency between pair (j,k).

### Claim 26 (depends on 21)

The device according to claim 21, wherein the number of values representable by the extension layer-ID is M and the second inter-dependency syntax structure comprises
one binary value for each pair (p,q) of extension values 0<q<p≤m<M, in order to indicate which layers among those comprising base layer-ID j are inter-layer prediction dependent on other layers among those comprising base layer-ID j, and
one binary value for each pair (p,q) of extension values 0<p,q≤m<M, in order to indicate which layer with extension value p and comprising base layer-ID j is inter-layer prediction dependent on layer with extension value q and comprising base layer-ID k<j.

### Claim 27 (depends on 21)

The device according to claim 21, wherein the device is configured to derive n from an explicitly signaling of a maximally assumed value among the N values representable by the base layer-ID, in the data stream, and/or derive m from an explicitly signaling of a maximally assumed value among the M values representable by the extension layer-ID, in the data stream.

### Claim 28 (depends on 21)

The device according to claim 21, where the first inter-dependency syntax structure defines interdependencies between different sets of layers and the second inter-dependency structure defines interdependencies between layers in dependent sets.

### Claim 29 (depends on 21)

The device according to claim 21, wherein the multi-layered video signal has the video material coded thereinto at the different layers using inter-layer prediction such that any layer inter-layer predicted from another layer adds one or more of further views;
depth information;
alpha blending information;
color component information;
spatial resolution refinement; and
SNR resolution refinement.

### Claim 30

A device configured to process a multi-layered data stream into which a video material is coded at different layers, corresponding to different levels of information amount, using inter-layer prediction, the multi-layer data stream comprising a plurality of packets, each of which is associated with one of the different layers, each layer being indexed by a base layer ID or a base layer ID and an extension layer ID, the device configured to:
read, from the multi-layered data stream,
a first inter-dependency syntax structure indicating interdependencies between pairs of different values representable by the base layer-ID, and
a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by the extension layer-ID, and
construct, based on the first and second inter-dependency syntax structures, an inter-layer dependency description revealing possible inter-layer prediction dependencies between the different layers.

### Claim 31

An encoder configured to encode into a multi-layered data stream a video material at different layers, corresponding to different levels of information amount, using inter-layer prediction, the multi-layer data stream comprising a plurality of packets, each of which is associated with one of the different layers, each layer being indexed by a base layer ID or a base layer ID and an extension layer ID, configured to:
insert, into the multi-layered data stream,
a first inter-dependency syntax structure indicating interdependencies between pairs of different values representable by the base layer-ID, and
a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by the extension layer-ID,
with setting the first and second inter-dependency syntax structures such that, based on the first and second inter-dependency syntax structures, an inter-layer dependency description revealing possible inter-layer prediction dependencies between the different layers is constructible.

### Claim 32

A method for encoding into a multi-layered data stream a video material at different layers, corresponding to different levels of information amount, using inter-layer prediction, the multi-layer data stream comprising a plurality of packets, each of which is associated with one of the different layers, each layer being indexed by a base layer ID or a base layer ID and an extension layer ID, comprising:
inserting, into the multi-layered data stream,
a first inter-dependency syntax structure indicating interdependencies between pairs of different values representable by the base layer-ID, and
a second inter-dependency syntax structure indicating inter-dependencies between pairs of different values representable by the extension layer-ID,
with setting the first and second inter-dependency syntax structures such that, based on the first and second inter-dependency syntax structures, an inter-layer dependency description revealing possible inter-layer prediction dependencies between the different layers is constructible.

### Claim 33 (depends on 32)

A non-transitory digital storage medium having computer-readable code stored thereon to perform, when said storage medium is run by a computer, a method according to claim 32.
