# US 2015/0103884 A1 · Signaling for sub-decoded picture buffer (sub-dpb) based dpb operations in video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0103884 A1
- Document ID: US20150103884A1
- Status: Published application
- Kind: A1
- Application number: 14/509,797
- Filed: 2014-10-08
- Published: 2015-04-16
- Earliest claimed: 2013-10-10
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Adarsh Krishnan Ramasubramonian; Ye-Kui Wang
- Web page: https://patentgrep.com/patent/US20150103884A1

## CPC

- H04N 19/156: Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
- H04N 19/177: the unit being a group of pictures [GOP]
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N 19/31: in the temporal domain
- H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence)
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/463: by compressing encoding parameters before transmission
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of decoding video data including receiving an encoded video bitstream that includes a plurality of pictures and storing the plurality of pictures in one or more sub-DPBs. The method further including receiving a respective set of sub-DPB parameters for each respective operation point of the encoded video bitstream. applying the respective set of sub-DPB parameters to all layers of an output layer set for each respective operation point, and performing a sub-DPB management process on the one or more sub-DPBs in accordance with the received respective single sets of sub-DPB parameters.

## Claims

### Claim 1

A method of decoding video data, the method comprising:
receiving an encoded video bitstream that includes a plurality of pictures;
storing the plurality of pictures in one or more sub-decoded picture buffers (DPBs);
receiving a respective set of sub-DPB parameters for each respective operation point of the encoded video bitstream;
applying the respective set of sub-DPB parameters to all layers of an output layer set for each respective operation point; and
performing a sub-DPB management process on the one or more sub-DPBs in accordance with the received respective single sets of sub-DPB parameters.

### Claim 2 (depends on 1)

The method of claim 1, wherein the sub-DPB parameters include at least one of a syntax element indicative of a maximum number of reorder pictures allowed for the one or more sub-DPBs or a syntax element indicative of a maximum latency allowed for the one or more sub-DPBs.

### Claim 3 (depends on 1)

The method of claim 1, wherein receiving the respective set of sub-DPB parameters comprises receiving the respective set of sub-DPB parameters in a video parameter set (VPS).

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
receiving a first respective sub-layer syntax element indicating whether or not sub-DPB parameters are signaled for each sub-layer of each respective output layer set.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
based on the first sub-layer syntax element indicating that sub-DPB parameters are not signaled for each sub-layer of a particular output layer set, applying the respective set of sub-DPB parameters to all sub-layers of the particular output layer set.

### Claim 6 (depends on 4)

The method of claim 4, further comprising:
based on the first sub-layer syntax element indicating that sub-DPB parameters may be signaled for each sub-layer of a particular output layer set, receiving a second respective sub-layer syntax element indicating whether or not sub-DPB parameters are signaled for respective sub-layers of the particular output layer set.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
based on the second respective sub-layer syntax element indicating that sub-DPB parameters are not signaled for a particular sub-layer, applying a last received respective set of sub-DPB parameters for the particular sub-layer; and
based on the second respective sub-layer syntax element indicating that sub-DPB parameters are signaled for the particular sub-layer, receiving an additional set of sub-DPB parameters for the particular sub-layer.

### Claim 8 (depends on 6)

The method of claim 6, further comprising:
based on the second respective sub-layer syntax element indicating that sub-DPB parameters are not signaled for a particular sub-layer with a sub-layer ID X, applying a last received respective set of sub-DPB parameters for sub-layers that have the sub-layer ID greater than X.

### Claim 9 (depends on 1)

The method of claim 1, wherein the sub-DPB management process includes at least one of marking pictures as unused for reference, marking pictures for output, or removing pictures from the sub-DPB, and wherein the performing the sub-DPB management process comprises performing the sub-DPB management process on an access unit level using the received respective sets of sub-DPB parameters.

### Claim 10 (depends on 9)

The method of claim 9, wherein performing the sub-DPB management process on the access unit level comprises:
outputting pictures based on the number of access units in a DPB that contain at least one picture marked as needed for output;
marking pictures as unused for reference on a per-layer level; and
removing pictures from the sub-DPB on a per-layer level.

### Claim 11

An apparatus configured to decode video data, the apparatus comprising:
one or more memory devices comprising one or more sub-decoded picture buffers (DPBs) configured to store video data; and
a video decoder configured to:
receive an encoded video bitstream that includes a plurality of pictures;
store the plurality of pictures in the one or more sub-DPBs;
receive a respective set of sub-DPB parameters for each respective operation point of the encoded video bitstream;
apply the respective set of sub-DPB parameters to all layers of an output layer set for each respective operation point; and
perform a sub-DPB management process on the one or more sub-DPBs in accordance with the received respective single sets of sub-DPB parameters.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the sub-DPB parameters include at least one of a syntax element indicative of a maximum number of reorder pictures allowed for the one or more sub-DPBs or a syntax element indicative of a maximum latency allowed for the one or more sub-DPBs.

### Claim 13 (depends on 11)

The apparatus of claim 11, wherein the video decoder is configured to receive the respective set of sub-DPB parameters in a video parameter set (VPS).

### Claim 14 (depends on 11)

The apparatus of claim 11, wherein the video decoder is further configured to:
receive a first respective sub-layer syntax element indicating whether or not sub-DPB parameters are signaled for each sub-layer of each respective output layer set.

### Claim 15 (depends on 14)

The apparatus of claim 14 wherein the video decoder is further configured to:
based on the first sub-layer syntax element indicating that sub-DPB parameters are not signaled for each sub-layer of a particular output layer set, apply the respective set of sub-DPB parameters to all sub-layers of the particular output layer set.

### Claim 16 (depends on 14)

The apparatus of claim 14, wherein the video decoder is further configured to:
based on the first sub-layer syntax element indicating that sub-DPB parameters may be signaled for each sub-layer of a particular output layer set, receive a second respective sub-layer syntax element indicating whether or not sub-DPB parameters are signaled for respective sub-layers of the particular output layer set.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the video decoder is further configured to:
based on the second respective sub-layer syntax element indicating that sub-DPB parameters are not signaled for a particular sub-layer, apply a last received respective set of sub-DPB parameters for the particular sub-layer; and
based on the second respective sub-layer syntax element indicating that sub-DPB parameters are signaled for the particular sub-layer, receive an additional set of sub-DPB parameters for the particular sub-layer.

### Claim 18 (depends on 16)

The apparatus of claim 16, wherein the video decoder is further configured to:
based on the second respective sub-layer syntax element indicating that sub-DPB parameters are not signaled for a particular sub-layer with a sub-layer ID X, apply a last received respective set of sub-DPB parameters for sub-layers that have the sub-layer ID greater than X.

### Claim 19 (depends on 11)

The apparatus of claim 11, wherein the sub-DPB management process includes at least one of marking pictures as unused for reference, marking pictures for output, or removing pictures from the sub-DPB, and wherein the performing the sub-DPB management process comprises performing the sub-DPB management process on an access unit level using the received respective sets of sub-DPB parameters.

### Claim 20 (depends on 19)

The apparatus of claim 19, wherein the video decoder is further configured to:
output pictures based on the number of access units in a DPB that contain at least one picture marked as needed for output;
mark pictures as unused for reference on a per-layer level; and
remove pictures from the sub-DPB on a per-layer level.

### Claim 21

An apparatus configured to decode video data, the apparatus comprising:
means for receiving an encoded video bitstream that includes a plurality of pictures;
means for storing the plurality of pictures in one or more sub-decoded picture buffers (DPBs);
means for receiving a respective set of sub-DPB parameters for each respective operation point of the encoded video bitstream;
means for applying the respective set of sub-DPB parameters to all layers of an output layer set for each respective operation point; and
means for performing a sub-DPB management process on the one or more sub-DPBs in accordance with the received respective single sets of sub-DPB parameters.

### Claim 22

A computer-readable storage medium storing instructions that, when executed, cause one or more processors of a device configured to decode video data to:
receive an encoded video bitstream that includes a plurality of pictures;
store the plurality of pictures in the one or more sub-DPBs;
receive a respective set of sub-DPB parameters for each respective operation point of the encoded video bitstream;
apply the respective set of sub-DPB parameters to all layers of an output layer set for each respective operation point; and
perform a sub-DPB management process on the one or more sub-DPBs in accordance with the received respective single sets of sub-DPB parameters.

### Claim 23

A method of encoding video data, the method comprising:
reconstructing a plurality of pictures of an encoded video bitstream;
storing the plurality of pictures in one or more sub-decoded picture buffers (DPBs);
generating a respective set of sub-DPB parameters for each respective operation point of the encoded video bitstream;
applying the respective set of sub-DPB parameters to all layers of an output layer set for each respective operation point;
performing a sub-DPB management process on the one or more sub-DPBs in accordance with the generated respective single sets of sub-DPB parameters; and
signaling the respective set of sub-DPB parameters in the encoded video bitstream.

### Claim 24 (depends on 23)

The method of claim 23, wherein the sub-DPB parameters include at least one of a syntax element indicative of a maximum number of reorder pictures allowed for the one or more sub-DPBs or a syntax element indicative of a maximum latency allowed for the one or more sub-DPBs.

### Claim 25 (depends on 23)

The method of claim 23, wherein generating the respective set of sub-DPB parameters comprises generating the respective set of sub-DPB parameters in a video parameter set (VPS).

### Claim 26 (depends on 23)

The method of claim 23, further comprising:
generating a first respective sub-layer syntax element indicating whether or not sub-DPB parameters are signaled for each sub-layer of each respective output layer set.

### Claim 27 (depends on 26)

The method of claim 26, further comprising:
based on the first sub-layer syntax element indicating that sub-DPB parameters may be signaled for each sub-layer of a particular output layer set, generating a second respective sub-layer syntax element indicating whether or not sub-DPB parameters are signaled for respective sub-layers of the particular output layer set.

### Claim 28 (depends on 27)

The method of claim 27, further comprising:
based on the second respective sub-layer syntax element indicating that sub-DPB parameters are signaled for the particular sub-layer, generating an additional set of sub-DPB parameters for the particular sub-layer.

### Claim 29 (depends on 23)

The method of claim 23, wherein the sub-DPB management process includes at least one of marking pictures as unused for reference, marking pictures for output, or removing pictures from the sub-DPB, and wherein the performing the sub-DPB management process comprises performing the sub-DPB management process on an access unit level using the received respective sets of sub-DPB parameters.

### Claim 30 (depends on 29)

The method of claim 29, wherein performing the sub-DPB management process on the access unit level comprises:
outputting pictures based on the number of access units in a DPB that contain at least one picture marked as needed for output;
marking pictures as unused for reference on a per-layer level; and
removing pictures from the sub-DPB on a per-layer level.

### Claim 31

An apparatus configured to encode video data, the apparatus comprising:
one or more memory devices comprising one or more sub-decoded picture buffers (DPBs) configured to store video data; and
a video encoder configured to:
reconstruct a plurality of pictures of an encoded video bitstream;
store the plurality of pictures in one or more sub-decoded picture buffers (DPBs);
generate a respective set of sub-DPB parameters for each respective operation point of the encoded video bitstream;
apply the respective set of sub-DPB parameters to all layers of an output layer set for each respective operation point;
perform a sub-DPB management process on the one or more sub-DPBs in accordance with the generated respective single sets of sub-DPB parameters; and
signal the respective set of sub-DPB parameters in the encoded video bitstream.

### Claim 32 (depends on 31)

The apparatus of claim 31, wherein the sub-DPB parameters include at least one of a syntax element indicative of a maximum number of reorder pictures allowed for the one or more sub-DPBs or a syntax element indicative of a maximum latency allowed for the one or more sub-DPBs.

### Claim 33 (depends on 31)

The apparatus of claim 31, wherein the video encoder is configured to generate the respective set of sub-DPB parameters in a video parameter set (VPS).

### Claim 34 (depends on 31)

The apparatus of claim 31, wherein the video encoder is further configured to:
generate a first respective sub-layer syntax element indicating whether or not sub-DPB parameters are signaled for each sub-layer of each respective output layer set.

### Claim 35 (depends on 34)

The apparatus of claim 34, wherein the video encoder is further configured to:
based on the first sub-layer syntax element indicating that sub-DPB parameters may be signaled for each sub-layer of a particular output layer set, generate a second respective sub-layer syntax element indicating whether or not sub-DPB parameters are signaled for respective sub-layers of the particular output layer set.

### Claim 36 (depends on 35)

The apparatus of claim 35, wherein the video encoder is further configured to:
based on the second respective sub-layer syntax element indicating that sub-DPB parameters are signaled for the particular sub-layer, generate an additional set of sub-DPB parameters for the particular sub-layer.

### Claim 37 (depends on 31)

The apparatus of claim 31, wherein the sub-DPB management process includes at least one of marking pictures as unused for reference, marking pictures for output, or removing pictures from the sub-DPB, and wherein the performing the sub-DPB management process comprises performing the sub-DPB management process on an access unit level using the received respective sets of sub-DPB parameters.

### Claim 38 (depends on 37)

The apparatus of claim 37, wherein the video encoder is further configured to:
output pictures based on the number of access units in a DPB that contain at least one picture marked as needed for output;
mark pictures as unused for reference on a per-layer level; and
remove pictures from the sub-DPB on a per-layer level.

### Claim 39

An apparatus configured to encode video data, the apparatus comprising:
means for reconstructing a plurality of pictures of an encoded video bitstream;
means for storing the plurality of pictures in one or more sub-decoded picture buffers (DPBs);
means for generating a respective set of sub-DPB parameters for each respective operation point of the encoded video bitstream;
means for applying the respective set of sub-DPB parameters to all layers of an output layer set for each respective operation point;
means for performing a sub-DPB management process on the one or more sub-DPBs in accordance with the generated respective single sets of sub-DPB parameters; and
means for signaling the respective set of sub-DPB parameters in the encoded video bitstream.

### Claim 40

A computer-readable storage medium storing instructions that, when executed, cause one or more processors of a device configured to encode video data to:
reconstruct a plurality of pictures of an encoded video bitstream;
store the plurality of pictures in one or more sub-decoded picture buffers (DPBs);
generate a respective set of sub-DPB parameters for each respective operation point of the encoded video bitstream;
apply the respective set of sub-DPB parameters to all layers of an output layer set for each respective operation point;
perform a sub-DPB management process on the one or more sub-DPBs in accordance with the generated respective single sets of sub-DPB parameters; and
signal the respective set of sub-DPB parameters in the encoded video bitstream.
