# US 11,310,512 B2 · Image decoding method and apparatus using same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,310,512 B2
- Document ID: US11310512B2
- Status: Granted
- Kind: B2
- Application number: 17/085,889
- Filed: 2020-10-30
- Published: 2021-04-08
- Granted: 2022-04-19
- Earliest claimed: 2012-11-21
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Hendry Hendry; Joonyoung Park; Chulkeun Kim; Byeongmoon Jeon; Jungsun Kim
- Web page: https://patentgrep.com/patent/US11310512B2

## CPC

- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 7/00: Television systems (details H04N3/00, H04N5/00; methods or arrangements, for coding, decoding, compressing or decompressing digital video signals H04N19/00; selective content distribution H04N21/00)
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/172: the region being a picture, frame or field
- H04N 19/184: the unit being bits, e.g. of the compressed video stream
- H04N 19/423: characterised by memory arrangements (H04N19/433 takes precedence)
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/58: Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one (H04N19/23 takes precedence)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image decoding method according to the present invention includes: receiving information on a set of reference pictures for configuring a set of reference pictures of a current picture, wherein the information on the set of reference pictures includes the most significant bit (MSB) information that may calculate the MSB of the picture order count (POC) of a long-term reference picture relative to the current picture, and flag information that represents whether there is MSB information; and eliciting the set of reference pictures by using received MSB information when the flag information is 1, and performing marking on the reference picture, wherein the flag information may be 1 when a temporal sub-layer identifier is 0, and there is at least one POC value for which a remainder obtained by dividing by a maximum value MaxPicOrderCntLsb capable of being represented by the LSB is the same as the least significant bit (LSB) of the POC of the long-term reference picture, in a set of POCs of a previous picture including POC values related to the previous picture that may not be discarded without affecting whether other pictures of the same temporal layer may be decoded.

## Claims

### Claim 1

A video decoding method, by a decoding apparatus, the method comprising:
receiving reference picture set (RPS) information, wherein the RPS information comprises flag information related to whether most significant bit (MSB) information for calculating an MSB of a picture order count (POC) of a long-term reference picture (LTRP) for a current picture is present, and wherein the RPS information further comprises the MSB information based on a case that a value of the flag information is equal to 1,
wherein the value of the flag information is equal to 1 based on a case that there is more than one POC value, in a previous picture POC set, for which the POC value modulo MaxPicOrderCntLsb is equal to a least significant bit (LSB) of the POC of the LTRP, MaxPicOrderCntLsb is a predetermined max least significant bit value, wherein the previous picture POC set is derived based on a previous picture of the current picture in decoding order, and the previous picture has a temporal sub-layer identifier equal to 0, and
wherein the previous picture POC set derived based on the previous picture of the current picture includes 1) a POC of each reference picture in an RPS for the previous picture in decoding order, and 2) a POC of each picture following the previous picture in decoding order and preceding the current picture in decoding order;
deriving an RPS for the current picture based on the MSB information based on a case that the value of the flag information is equal to 1;
performing inter prediction for a block in the current picture based on the RPS; and
reconstructing the current picture based on the result of the inter prediction,
wherein the flag information and the MSB information are configured in a slice header.

### Claim 2 (depends on 1)

The method of claim 1, wherein the previous picture cannot be discarded without affecting decodability of another picture in the same temporal layer, and
wherein the previous picture has a network abstraction layer (NAL) unit type not equal to TRAIL_N, TSA_N, STSA_N, RADL_N, RASL_N, RASL_R, RSV_VCL_N10, RSV_VCL_N12, or RSV_VCL_N14.

### Claim 3 (depends on 1)

The method of claim 1, wherein the previous picture is not a sub-layer non-reference picture which is not used for inter prediction in the decoding process of subsequent pictures of the same sub-layer in decoding order.

### Claim 4 (depends on 1)

The method of claim 1, wherein the previous picture POC set further include a POC of the previous picture.

### Claim 5 (depends on 1)

The method of claim 1, wherein the MSB information is MSB cycle information determining a value corresponding to a difference in POC MSB between the current picture and the LTRP.

### Claim 6 (depends on 1)

The method of claim 1, further comprising constructing a POC list for deriving the RPS,
wherein the POC list comprises a short-term reference picture (STRP) POC list comprising a POC of an STRP for the current picture and an LTRP POC list comprising the POC of the LTRP for the current picture, the STRP POC list is generated using a difference in POC between the current picture and the STRP, and the LTRP POC list is generated by an operation that is POC of current picture—DeltaPocMsbCycleLt* MaxPicOrderCntLsb —POC LSB of current picture +POC LSB of LTRP, DeltaPocMsbCycleLt having a value corresponding to a difference in POC MSB between the current picture and the LTRP.

### Claim 7 (depends on 6)

The method of claim 6, wherein the deriving the RPS comprises:
constructing an LTRP set using a picture with a POC LSB or POC equal to a POC in the LTRP POC list based on a case that there is the picture in a decoded picture buffer (DPB) storing a reconstructed picture;
marking all pictures in the LTRP set as “used for long-term reference;”
constructing an STRP set using a picture with a POC equal to a POC in the STRP POC list based on a case that there is the picture in the DBP; and
marking all reference pictures in the DPB which are not included on the LTRP set and the STRP set as “unused for reference.”

### Claim 8 (depends on 1)

The method of claim 1, wherein the reconstructed current picture is marked as “used for short-term reference.”

### Claim 9

A video encoding method, by an encoding apparatus, the method comprising:
deriving reference picture set (RPS) information, wherein the RPS information comprises flag information related to whether most significant bit (MSB) information for calculating an MSB of a picture order count (POC) of a long-term reference picture (LTRP) for a current picture is present, and wherein the RPS information further comprises the MSB information based on a case that a value of the flag information is equal to 1,
wherein the value of the flag information is equal to 1 based on a case that there is more than one POC value, in a previous picture POC set, for which the POC value modulo MaxPicOrderCntLsb is equal to a least significant bit (LSB) of the POC of the LTRP, MaxPicOrderCntLsb is a predetermined max least significant bit value, wherein the previous picture POC set is derived based on a previous picture of the current picture in decoding order, and the previous picture has a temporal sub-layer identifier equal to 0, and
wherein the previous picture POC set derived based on the previous picture of the current picture includes 1) a POC of each reference picture in an RPS for the previous picture in decoding order, and 2) a POC of each picture following the previous picture in decoding order and preceding the current picture in decoding order; and
generating a bitstream by encoding video information including the RPS information, wherein the flag information and the MSB information are configured in a slice header.

### Claim 10 (depends on 9)

The method of claim 9, wherein the previous picture cannot be discarded without affecting decodability of another picture in the same temporal layer, and
wherein the previous picture has a network abstraction layer (NAL) unit type not equal to TRAIL_N, TSA_N, STSA_N, RADL_N, RASL_N, RASL_R, RSV_VCL_N10, RSV_VCL_N12, or RSV_VCL_N14.

### Claim 11 (depends on 9)

The method of claim 9, wherein the previous picture is not a sub-layer non-reference picture which is not used for inter prediction in the decoding process of subsequent pictures of the same sub-layer in decoding order.

### Claim 12 (depends on 9)

The method of claim 9, wherein the previous picture POC set further include a POC of the previous picture.

### Claim 13 (depends on 9)

The method of claim 9, wherein the MSB information is MSB cycle information determining a value corresponding to a difference in POC MSB between the current picture and the LTRP.

### Claim 14 (depends on 9)

The method of claim 9, further comprising constructing a POC list for deriving the RPS,
wherein the POC list comprises a short-term reference picture (STRP) POC list comprising a POC of an STRP for the current picture and an LTRP POC list comprising the POC of the LTRP for the current picture, the STRP POC list is generated using a difference in POC between the current picture and the STRP, and the LTRP POC list is generated by an operation that is POC of current picture—DeltaPocMsbCycleLt* MaxPicOrderCntLsb —POC LSB of current picture +POC LSB of LTRP, DeltaPocMsbCycleLt having a value corresponding to a difference in POC MSB between the current picture and the LTRP.

### Claim 15 (depends on 14)

The method of claim 14, wherein the deriving the RPS comprises:
constructing an LTRP set using a picture with a POC LSB or POC equal to a POC in the LTRP POC list based on a case that there is the picture in a decoded picture buffer (DPB) storing a reconstructed picture;
marking all pictures in the LTRP set as “used for long-term reference;”
constructing an STRP set using a picture with a POC equal to a POC in the STRP POC list based on a case that there is the picture in the DBP; and
marking all reference pictures in the DPB which are not included on the LTRP set and the STRP set as “unused for reference.”

### Claim 16

A non-transitory decoder-readable storage medium storing a bitstream generated by performing the steps of: deriving reference picture set (RPS) information, wherein the RPS information comprises flag information related to whether most significant bit (MSB) information for calculating an MSB of a picture order count (POC) of a long-term reference picture (LTRP) for a current picture is present, and wherein the RPS information further comprises the MSB information based on a case that a value of the flag information is equal to 1; and generating the bitstream by encoding video information including the RPS information,
wherein the value of the flag information is equal to 1 based on a case that there is more than one POC value, in a previous picture POC set, for which the POC value modulo MaxPicOrderCntLsb is equal to a least significant bit (LSB) of the POC of the LTRP, MaxPicOrderCntLsb is a predetermined max least significant bit value, wherein the previous picture POC set is derived based on a previous picture of the current picture in decoding order, and the previous picture has a temporal sub-layer identifier equal to 0, and
wherein the previous picture POC set derived based on the previous picture of the current picture includes 1) a POC of each reference picture in an RPS for the previous picture in decoding order, and 2) a POC of each picture following the previous picture in decoding order and preceding the current picture in decoding order; and
wherein the flag information and the MSB information are configured in a slice header.
