# US 2020/0404280 A1 · Layered random access with reference picture resampling

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404280 A1
- Document ID: US20200404280A1
- Status: Published application
- Kind: A1
- Application number: 16/902,972
- Filed: 2020-06-16
- Published: 2020-12-24
- Earliest claimed: 2019-06-20
- Assignees: Tencent America LLC
- Applicants: Tencent America LLC
- Inventors: Byeongdoo Choi; Stephan Wenger; Shan Liu
- Web page: https://patentgrep.com/patent/US20200404280A1

## CPC

- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/31: in the temporal domain
- H04N 19/34: Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
- H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of decoding an encoded video bitstream using at least one processor, including obtaining a coded base layer picture and a coded enhancement layer picture included in an LRA access unit; determining whether a random access occurs at the LRA access unit; based on the random access not occurring at the LRA access unit, generating a reconstructed base layer picture by reconstructing the coded base layer picture, and generating a reconstructed enhancement layer picture by reconstructing the coded enhancement layer picture using the reconstructed base layer picture and a previously reconstructed picture; based on the random access occurring at the LRA access unit, generating the reconstructed base layer picture by reconstructing the coded base layer picture, and generating the reconstructed enhancement layer picture by upsampling the reconstructed base layer picture; and outputting the reconstructed enhancement layer picture.

## Claims

### Claim 1

A method of decoding an encoded video bitstream using at least one processor, the method comprising:
obtaining from the encoded video bitstream a coded base layer picture included in a layered random access (LRA) access unit, and a coded enhancement layer picture included in the LRA access unit;
determining whether a random access occurs at the LRA access unit;
based on the random access not occurring at the LRA access unit, generating a reconstructed base layer picture by reconstructing the coded base layer picture, and generating a reconstructed enhancement layer picture by reconstructing the coded enhancement layer picture using the reconstructed base layer picture and a previously reconstructed picture;
based on the random access occurring at the LRA access unit, generating the reconstructed base layer picture by reconstructing the coded base layer picture; and
outputting the reconstructed enhancement layer picture.

### Claim 2 (depends on 1)

The method of claim 1, wherein based on the random access occurring at the LRA access unit, if the previously reconstructed picture is unavailable, the method further comprises generating the reconstructed enhancement layer picture based on a reference picture generated by filling virtual data, upsampling or filtering the reconstructed base layer picture.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
storing the reconstructed enhancement layer picture into a decoded picture buffer; and
reconstructing a following picture using the reconstructed enhancement layer picture.

### Claim 4 (depends on 1)

The method of claim 1, wherein the coded base layer picture has a first picture type, and
wherein the coded enhancement layer picture has a second picture type different from the first picture type.

### Claim 5 (depends on 4)

The method of claim 4, wherein the first picture type is an intra-coded picture type, and
wherein the second picture type is one from among a predicted picture type and a bidirectional predicted picture type.

### Claim 6 (depends on 5)

The method of claim 5, wherein the first picture type is one from among an instantaneous decoder refresh picture type and a clean random access picture type.

### Claim 7 (depends on 1)

The method of claim 1, wherein the reconstructed base layer picture is upsampled using an adaptive resolution change (ARC) process.

### Claim 8 (depends on 7)

The method of claim 7, wherein ARC parameters used in the ARC process are signaled in one from among a slice header, a group of pictures header, a tile header, and a tile group header.

### Claim 9 (depends on 7)

The method of claim 7, wherein ARC parameters used in the ARC process are signaled in one from among a picture parameter set, a header parameter set, a tile parameter set, and an adaptation parameter set.

### Claim 10 (depends on 7)

The method of claim 7, wherein ARC parameters used in the ARC process are signaled in a tile group header.

### Claim 11

A device for decoding an encoded video bitstream, the device comprising:
at least one memory configured to store program code; and
at least one processor configured to read the program code and operate as instructed by the program code, the program code including:
first obtaining code configured to cause the at least one processor to obtain from the encoded video bitstream a coded base layer picture included in a layered random access (LRA) access unit, and a coded enhancement layer picture included in the LRA access unit;
determining code configured to cause the at least one processor to determine whether a random access occurs at the LRA access unit;
first generating code configured to cause the at least one processor to, based on the random access not occurring at the LRA access unit, generate a reconstructed base layer picture by reconstructing the coded base layer picture, and generate a reconstructed enhancement layer picture by reconstructing the coded enhancement layer picture using the reconstructed base layer picture and a previously reconstructed picture;
second generating code configured to cause the at least one processor to, based on the random access occurring at the LRA access unit, generate the reconstructed base layer picture by reconstructing the coded base layer picture, and generate the reconstructed enhancement layer picture by upsampling the reconstructed base layer picture; and
output code configured to cause the at least one processor to output the reconstructed enhancement layer picture.

### Claim 12 (depends on 11)

The device of claim 11, wherein based on the random access occurring at the LRA access unit, the previously reconstructed picture is unavailable

### Claim 13 (depends on 11)

The device of claim 11, wherein the program code further comprises:
storing code configured to cause the at least one processor to store the reconstructed enhancement layer picture into a decoded picture buffer; and
reconstructing code configured to cause the at least one processor to reconstruct a following picture using the reconstructed enhancement layer picture.

### Claim 14 (depends on 11)

The device of claim 11, wherein the coded base layer picture has a first picture type, and
wherein the coded enhancement layer picture has a second picture type different from the first picture type.

### Claim 15 (depends on 14)

The device of claim 14, wherein the first picture type is an intra-coded picture type, and
wherein the second picture type is one from among a predicted picture type and a bidirectional predicted picture type.

### Claim 16 (depends on 11)

The device of claim 11, wherein the reconstructed base layer picture is upsampled using an adaptive resolution change (ARC) process.

### Claim 17 (depends on 16)

The device of claim 16, wherein ARC parameters used in the ARC process are signaled in one from among a slice header, a group of pictures header, a tile header, and a tile group header.

### Claim 18 (depends on 16)

The device of claim 16, wherein ARC parameters used in the ARC process are signaled in one from among a picture parameter set, a header parameter set, a tile parameter set, and an adaptation parameter set.

### Claim 19 (depends on 16)

The device of claim 16, wherein ARC parameters used in the ARC process are signaled in a tile group header.

### Claim 20

A non-transitory computer-readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device for decoding an encoded video bitstream, cause the one or more processors to:
obtain from the encoded video bitstream a coded base layer picture included in a layered random access (LRA) access unit, and a coded enhancement layer picture included in the LRA access unit;
determine whether a random access occurs at the LRA access unit;
based on the random access not occurring at the LRA access unit, generate a reconstructed base layer picture by reconstructing the coded base layer picture, and generate a reconstructed enhancement layer picture by reconstructing the coded enhancement layer picture using the reconstructed base layer picture and a previously reconstructed picture;
based on the random access occurring at the LRA access unit, generate the reconstructed base layer picture by reconstructing the coded base layer picture, and generate the reconstructed enhancement layer picture by upsampling the reconstructed base layer picture; and
output the reconstructed enhancement layer picture.
