# US 2020/0404303 A1 · Method for support of scalability with adaptive picture resolution

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0404303 A1
- Document ID: US20200404303A1
- Status: Published application
- Kind: A1
- Application number: 16/905,475
- Filed: 2020-06-18
- Published: 2020-12-24
- Earliest claimed: 2019-06-20
- Assignees: Tencent America LLC
- Applicants: Tencent America LLC
- Inventors: Byeongdoo Choi; Stephan Wenger; Shan Liu
- Web page: https://patentgrep.com/patent/US20200404303A1

## CPC

- H04N 19/31: in the temporal domain
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method and apparatus for decoding multiple semantically independent picture parts into a single video picture includes decoding unique picture order count values for each coded picture, coded slice, or coded tile in a coded video sequence, with multiple decoded pictures, cycles, and tiles belonging to a same access unit representing a frame of the video. A value representing the amount of pictures, cycles, or tiles, is then assigned to each access unit for assigning sequential access unit count values to the access units. As a result, each access unit, which represents multiple pictures, slices, or tiles to be combined into a single frame, is decoded for display processing.

## Claims

### Claim 1

A method for video decoding, comprising:
decoding at least one of a first coded picture, a first coded slice, and a first coded tile with a first value of a picture order count included in a coded video sequence; and
decoding at least one of a second coded picture, a second coded slice, and a second coded tile with a second value of the picture order count included in the coded video sequence;
wherein the at least one of the first coded picture, the first coded slice, and the first coded tile and the at least one of the second coded picture, the second coded slice, and the second coded title belong to a same access unit, wherein the first and the second values of the picture order count are different, and wherein an access unit corresponds to a time instance.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
decoding, from a high level syntax structure, a syntax element poc_cycle_au, wherein the value of poc_cycle_au is indicative of a maximum difference of the first and the second values of the picture order count in an access unit.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
decoding, from the high level syntax structure, a syntax element vps_poc_cycle_au, wherein a value of ps_poc_cycle_au is indicative of all coded pictures or slices in a coded video sequence; and
decoding, from the high level syntax structure, a syntax element slice_poc_cycle_au, wherein a value of slice_poc_cycle_au is indicative of the poc_cycle_au of a current slice.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
determining if poc_cycle_au is constant in all access units of the coded video sequence;
calculating, based on poc_cycle_au being constant for each access unit in the coded video sequence, a value of a first access unit count by dividing the first value of the picture order count by the value of ps_poc_cycle_au; and
calculating, based on poc_cycle_au being variable the access units in the coded video sequence, the value of the first access unit count by dividing the first value of the picture order count by the value of slice_poc_cycle_au.

### Claim 5 (depends on 3)

The method of claim 3, wherein the high level syntax structure is a video parameter set or a sequence parameter set.

### Claim 6 (depends on 1)

The method of claim 1, wherein a maximum difference of the first and second values of the picture order count is derived from scalability structure information included in a video parameter set.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
decoding a temporal identifier value for each coded picture, coded slice, or coded tile, the temporal identifier value indicating a temporal sub-layer, wherein each coded picture, coded slice, or coded tile in a same access unit has a same temporal identifier value; and
decoding a spatial identifier value for each coded picture, coded slice, or coded tile, the spatial layer identifier value indicating a spatial layer.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
decoding scalability structure information from one of a slice header, a group of blocks (GOB) header, a tile header, and a tile group header.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
decoding scalability structure from one of a picture parameter set, a header parameter set, a tile parameter set, and an adaptation parameter set.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
decoding reference information from one of a slice header, a group of blocks (GOB) header, a tile header, and a tile group header;
decoding, from a location indicated in the reference information, a scalability structure from one of a picture parameter set, a header parameter set, a tile parameter set, and an adaptation parameter set.

### Claim 11

A device for video decoding comprising:
at least one memory configured to store program code; and
at least one processor configured to read the program code and operate as instructed by the program code, the program code including:
first decoding code configured to cause the at least one processor to decode at least one of a first coded picture, a first coded slice, and a first coded tile with a first value of a picture order count included in a coded video sequence; and
second decoding code configured to cause the at least one processor to decode at least one of a second coded picture, a second coded slice, and a second coded tile with a second value of the picture order count included in the coded video sequence;
wherein the at least one of the first coded picture, the first coded slice, and the first coded tile and the at least one of the second coded picture, the second coded slice, and the second coded tile belong to a same access unit, wherein the first and the second values of the picture order count are different, and wherein an access unit corresponds to a time instance.

### Claim 12 (depends on 11)

The device of claim 11, further comprising:
third decoding code configured to cause the at least one processor to decode, from a high level syntax structure, a syntax element poc_cycle_au, wherein a value of poc_cycle_au is indicative of a maximum difference of the first and the second values of the picture order count.

### Claim 13 (depends on 12)

The device of claim 12, further comprising:
fourth decoding code configured to cause the at least one processor to decode, from the high level syntax structure, a syntax element of vps_poc_cycle_au, wherein the value of ps_poc_cycle_au is indicative of all coded pictures or slices in a coded video sequence; and
fifth decoding code configured to cause the at least one processor to decode, from the high level syntax structure, a syntax element of slice_poc_cycle_au, wherein the value of slice_poc_cycle_au is indicative of the poc_cycle_au of a current slice.

### Claim 14 (depends on 12)

The device of claim 12, further comprising:
first determining code configured to cause the at least one processor to determine if poc_cycle_au is constant for all access units in the coded video sequence;
first calculating code configured to cause the at least one processor to calculate, based on poc_cycle_au being constant for each access unit in the coded video sequence, a value of a first access unit count by dividing the first value of the picture order count by the value of ps_poc_cycle_au; and
second calculating code configured to cause the at least one processor to calculate, based on poc_cycle_au being variable across access units in the coded video sequence, the value of the first access unit count by dividing the first value of the picture order count by the value of slice_poc_cycle_au.

### Claim 15 (depends on 12)

The device of claim 12, wherein a maximum difference of the first and second value of the picture order count is derived from scalability structure information included in a video parameter set.

### Claim 16 (depends on 11)

The device of claim 11, further comprising:
sixth decoding code configured to cause the at least one processor to decode a temporal identifier value for each coded picture, coded slice, or coded tile, the temporal identifier value indicating a temporal sub-layer, wherein each coded picture, coded slice, or coded tile in a same access unit has a same temporal identifier value; and
seventh decoding code configured to cause the at least one processor to decode a spatial identifier value for each coded picture, coded slice, or coded tile, the spatial layer identifier value indicating a spatial layer.

### Claim 17 (depends on 11)

The device of claim 11, further comprising:
eighth decoding code configured to cause the at least one processor to decode scalability structure information from one of a slice header, a group of blocks (GOB) header, a tile header, and a tile group header.

### Claim 18 (depends on 11)

The device of claim 11, further comprising:
ninth decoding code configured to cause the at least one processor to decode scalability structure from one of a picture parameter set, a header parameter set, a tile parameter set, and an adaptation parameter set.

### Claim 19 (depends on 11)

The device of claim 11, further comprising:
tenth decoding code configured to cause the at least one processor to decode reference information from one of a slice header, a group of blocks (GOB) header, a tile header, and a tile group header;
eleventh decoding code configured to cause the at least one processor to decode, from a location indicated in the reference information, scalability structure from one of a picture parameter set, a header parameter set, a tile parameter set, and an adaptation parameter set.

### Claim 20

A non-transitory computer readable medium storing instructions, the instructions comprising: one or more instructions that, when executed by one or more processors of a device, cause one or more processors to:
decode at least one of a first coded picture, a first coded slice, and a first coded tile with a first value of a picture order count included in a coded video sequence; and
decode at least one of a second coded picture, a second coded slice, and a second coded tile with a second value of the picture order count included in the coded video sequence;
wherein the at least one of the first coded picture, the first coded slice, and the first coded tile and the at least one of the second coded picture, the second coded slice, and the second coded tile belong to a same access unit, wherein the first and the second values of the picture order count are different, and wherein an access unit corresponds to a time instance.
