# US 2019/0379903 A1 · Signaling of state information for a decoded picture buffer and reference picture lists

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0379903 A1
- Document ID: US20190379903A1
- Status: Published application
- Kind: A1
- Application number: 16/546,871
- Filed: 2019-08-21
- Published: 2019-12-12
- Earliest claimed: 2011-11-07
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Gary J. Sullivan; Yongjun Wu
- Web page: https://patentgrep.com/patent/US20190379903A1

## CPC

- H04N 19/58: Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one (H04N19/23 takes precedence)
- H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence)
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Innovations for signaling state of a decoded picture buffer (“DPB”) and reference picture lists (“RPLs”). In example implementations, rather than rely on internal state of a decoder to manage and update DPB and RPLs, state information about the DPB and RPLs is explicitly signaled. This permits a decoder to determine which pictures are expected to be available for reference from the signaled state information. For example, an encoder determines state information that identifies which pictures are available for use as reference pictures (optionally considering feedback information from a decoder about which pictures are available). The encoder sets syntax elements that represent the state information. In doing so, the encoder sets identifying information for a long-term reference picture (“LTRP”), where the identifying information is a value of picture order count least significant bits for the LTRB. The encoder then outputs the syntax elements as part of a bitstream.

## Claims

### Claim at position 1

-44. (canceled)

### Claim 45

In a computing system that implements a video decoder, a method comprising:
encoding a current picture, among pictures of a sequence, to produce coded data, including:
determining long-term reference picture (“LTRP”) status information for the current picture, wherein the LTRP status information for the current picture identifies which pictures, if any, are available for use as LTRPs for the current picture; and
setting syntax elements that represent the LTRP status information for the current picture, including setting identifying information for a given LTRP in the LTRP status information for the current picture, wherein the identifying information for the given LTRP is a value of picture order count least significant bits (“POC LSBs”) for the given LTRP for the current picture, and wherein the value of the POC LSBs for the given LTRP, modulo a most significant bit wrapping point, is used to at least in part indicate a difference between POC values of the current picture and the given LTRP; and
outputting the coded data as part of a bitstream, the coded data including the syntax elements that represent the LTRP status information for the current picture.

### Claim 46 (depends on 45)

The method of claim 45, further comprising:
determining whether to include LTRP status information in the bitstream for the pictures of the sequence; and
outputting, as part of a sequence parameter set, a flag that indicates whether LTRP status information is present in the bitstream for the pictures of the sequence.

### Claim 47 (depends on 45)

The method of claim 45, wherein the syntax elements that represent the LTRP status information for the current picture are signaled in the bitstream for the current picture.

### Claim 48 (depends on 45)

The method of claim 45, further comprising:
setting a number of bits for POC LSBs to use for values of POC LSBs for LTRPs; and
outputting a syntax element that indicates the number of bits for POC LSBs.

### Claim 49 (depends on 45)

The method of claim 45, wherein the setting the syntax elements that represent the LTRP status information for the current picture further includes setting a flag for the given LTRP in the LTRP status information for the current picture, the flag for the given LTRP indicating whether the given LTRP is used for decoding of the current picture.

### Claim 50 (depends on 45)

The method of claim 45, further comprising, as part of the encoding the current picture:
setting a flag for the given LTRP in the LTRP status information for the current picture, wherein the flag for the given LTRP facilitates reuse of the value of POC LSBs for the given LTRP as a value of POC LSBs for another reference picture while the given LTRP remains distinctly identified compared to the other reference picture.

### Claim 51 (depends on 45)

The method of claim 45, wherein the determining the LTRP status information for the current picture and/or the setting the syntax elements is subject to a constraint that POC value for each picture that is a reference picture for the current picture or waiting for output is computed unambiguously relative to the POC value of the current picture.

### Claim 52 (depends on 45)

The method of claim 45, wherein the determining the LTRP status information for the current picture and/or the setting the syntax elements is subject to a constraint on range of POC values for the current picture and its reference pictures.

### Claim 53

A computing system comprising
a buffer configured to store at least part of a bitstream; and
a video decoder, implemented using a processor and memory, configured to perform operations comprising:
parsing syntax elements from the bitstream, wherein the syntax elements represent long-term reference picture (“LTRP”) status information for a current picture among pictures of a sequence, wherein the LTRP status information for the current picture identifies which pictures, if any, are available for use as LTRPs for the current picture, the syntax elements including identifying information for a given LTRP in the LTRP status information for the current picture, and wherein the identifying information for the given LTRP is a value of picture order count least significant bits (“POC LSBs”), modulo a most significant bit wrapping point, for the given LTRP for the current picture; and
using the LTRP status information during decoding, wherein the value of the POC LSBs for the given LTRP, modulo the most significant bit wrapping point, is used to at least in part indicate a difference between POC values of the current picture and the given LTRP.

### Claim 54 (depends on 53)

The computing system of claim 53, wherein the operations further comprise:
parsing, from a sequence parameter set, a flag that indicates whether LTRP status information is present in the bitstream for the pictures of the sequence.

### Claim 55 (depends on 53)

The computing system of claim 53, wherein the syntax elements that represent the LTRP status information for the current picture are signaled in the bitstream for the current picture.

### Claim 56 (depends on 53)

The computing system of claim 53, wherein the operations further comprise:
parsing a syntax element that indicates a number of bits for POC LSBs to use for values of POC LSBs for LTRPs; and
using the number of bits for POC LSBs when parsing the value of POC LSBs for the given LTRP.

### Claim 57 (depends on 53)

The computing system of claim 53, wherein the operations further comprise:
using the LTRP status information to manage a decoded picture storage area of the video decoder.

### Claim 58 (depends on 53)

The computing system of claim 53, wherein the syntax elements further include a flag for the given LTRP, the flag for the given LTRP indicating whether the given LTRP is used for decoding of the current picture.

### Claim 59 (depends on 53)

The computing system of claim 53, wherein the operations further comprise:
sending feedback information for use by a video encoder during encoding, wherein the feedback information represents decoder state information that identifies which pictures are available for use as reference pictures by the video decoder.

### Claim 60

One or more computer-readable storage media storing coded data for at least part of a bitstream, the one or more computer-readable storage media being selected from the group consisting of volatile memory, non-volatile memory, magnetic disk, CD-ROM and DVD, wherein the bitstream includes syntax elements that represent long-term reference picture (“LTRP”) status information for a current picture among pictures of a sequence, wherein the LTRP status information for the current picture identifies which pictures, if any, are available for use as LTRPs for the current picture, the syntax elements including identifying information for a given LTRP in the LTRP status information for the current picture, and wherein the identifying information for the given LTRP is a value of picture order count least significant bits (“POC LSBs”), modulo a most significant bit wrapping point, for the given LTRP for the current picture, the coded data being organized to facilitate decoding by operations comprising:
parsing the syntax elements from the bitstream; and
using the LTRP status information during decoding, wherein the value of the POC LSBs for the given LTRP, modulo the most significant bit wrapping point, is used to at least in part indicate a difference between POC values of the current picture and the given LTRP.

### Claim 61 (depends on 60)

The one or more computer-readable storage media of claim 60, wherein the bitstream further includes, as part of a sequence parameter set, a flag that indicates whether LTRP status information is present in the bitstream for pictures of a sequence, and wherein the operations further comprise parsing, from the sequence parameter set, the flag.

### Claim 62 (depends on 60)

The one or more computer-readable storage media of claim 60, wherein the bitstream further includes a syntax element that indicates a number of bits for POC LSBs to use for values of POC LSBs for LTRPs, and wherein the operations further comprise:
parsing the syntax element that indicates a number of bits for POC LSBs to use for values of POC LSBs for LTRPs; and
using the number of bits for POC LSBs when parsing the value of POC LSBs for the given LTRP.

### Claim 63 (depends on 60)

The one or more computer-readable storage media of claim 60, wherein the syntax elements further include a flag for the given LTRP, the flag for the given LTRP indicating whether the given LTRP is used for decoding of the current picture.

### Claim 64 (depends on 60)

The one or more computer-readable storage media of claim 60, wherein the operations further comprise:
using the LTRP status information to manage a decoded picture storage area of a video decoder.
