# US 2024/0205437 A1 · Sub-picture Level Indicator Signaling In Video Coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0205437 A1
- Document ID: US20240205437A1
- Status: Published application
- Kind: A1
- Application number: 18/590,822
- Filed: 2024-02-28
- Published: 2024-06-20
- Earliest claimed: 2019-01-09
- Assignees: Huawei Technologies Co., Ltd.
- Applicants: Huawei Technologies Co., Ltd.
- Inventors: Ye-Kui Wang; FNU Hendry
- Web page: https://patentgrep.com/patent/US20240205437A1

## CPC

- H04N 19/436: using parallelised computational arrangements
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference
- H04N 19/17: the unit being an image region, e.g. an object
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/184: the unit being bits, e.g. of the compressed video stream
- H04N 19/188: {the unit being a video data packet, e.g. a network abstraction layer [NAL] unit}
- H04N 19/1883: {the unit relating to sub-band structure, e.g. hierarchical level, directional tree, e.g. low-high [LH], high-low [HL], high-high [HH]}
- H04N 19/29: involving scalability at the object level, e.g. video object layer [VOL]
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/593: involving spatial prediction techniques
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/31: in the temporal domain
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising one or more sub-pictures partitioned from a picture and a sub-picture level indicator indicating resource requirements for decoding a current sub-picture. The bitstream is parsed to obtain the sub-picture level indicator and the current sub-picture. Resources are allocated to decode the current sub-picture based on the sub-picture level indicator. The current sub-picture is decoded to create a video sequence by employing the allocated resources. The video sequence is forwarded for display.

## Claims

### Claim 1

A non-transitory computer readable medium comprising a computer program product for use by a video coding device, the computer program product comprising computer executable instructions stored on the non-transitory computer readable medium such that when executed by a processor cause the video coding device to:
receive a bitstream comprising a sequence parameter set (SPS), a plurality of sub-pictures partitioned from a picture, a plurality of sub-picture level indicators including a plurality of first sub-picture level indicators, a nesting supplemental enhancement information (SEI) message containing sub-picture identifiers (IDs) of the sub-pictures, and a second sub-picture level indicator, wherein each first sub-picture level indicator indicates a level for each sub-picture, each level specifying resource requirements for decoding an associated sub-picture sequence, wherein the second sub-picture level indicator indicates a sub-picture bitrate, and wherein the SPS comprises a separate sub-picture ID, sub-picture size, and sub-picture position for each of the plurality of sub-pictures;
parse the bitstream to obtain the sub-picture level indicators and a current sub-picture;
allocate resources to decode the current sub-picture based on the sub-picture level indicators; and
decode the current sub-picture to create a video sequence by employing the allocated resources.

### Claim 2 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the sub-picture level indicators are included in a SEI message in the bitstream.

### Claim 3 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the sub-picture level indicators are included in the SPS.

### Claim 4 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the sub-picture level indicators further indicate a sub-picture pixel count.

### Claim 5 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the sub-picture level indicators further indicate a sub-picture size.

### Claim 6 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the first sub-picture level indicators are an array that contains level identifiers indicating a level for each sequence extracted from each sub-picture.

### Claim 7

A method implemented by an encoder, the method comprising:
partitioning a picture into a plurality of sub-pictures;
encoding a bitstream comprising a sequence parameter set (SPS), the picture partitioned into the plurality of sub-pictures, a plurality of sub-picture level indicators including a plurality of first sub-picture level indicators, a nesting supplemental enhancement information (SEI) message containing sub-picture identifiers (IDs) of the sub-pictures, and a second sub-picture level indicator, wherein each first sub-picture level indicator indicates a level for each sub-picture, each level specifying a capability for decoding an associated sub-picture sequence, wherein the second sub-picture level indicator indicates a sub-picture bitrate, and wherein the SPS comprises a separate sub-picture ID, sub-picture size, and sub-picture position for each of the plurality of sub-pictures; and
storing the bitstream.

### Claim 8 (depends on 7)

The method of claim 7, wherein the bitstream further comprises a SEI message, and wherein the SEI message comprises the sub-picture level indicators.

### Claim 9 (depends on 7)

The method of claim 7, wherein the sub-picture level indicators are included in the SPS.

### Claim 10 (depends on 7)

The method of claim 7, wherein the sub-picture level indicators further indicate a sub-picture pixel count.

### Claim 11 (depends on 7)

The method of claim 7, wherein the sub-picture level indicators further indicate the sub-picture size.

### Claim 12 (depends on 7)

The method of claim 7, wherein the first sub-picture level indicators are an array that contains level identifiers indicating a level for each sequence extracted from each sub-picture.

### Claim 13

An encoder comprising:
a processor configured to:
partition a picture into a plurality of sub-pictures; and
encode a bitstream comprising a sequence parameter set (SPS), the picture partitioned into the plurality of sub-pictures, a plurality of sub-picture level indicators including a plurality of first sub-picture level indicators, a nesting supplemental enhancement information (SEI) message containing sub-picture identifiers (IDs) of the sub-pictures, and a second sub-picture level indicator, wherein each sub-picture level indicator indicates a level for each sub-picture, each level specifying a capability for decoding an associated sub-picture sequence, wherein the second sub-picture level indicator indicates a sub-picture bitrate, and wherein the SPS comprises a separate sub-picture ID, sub-picture size, and sub-picture position for each of the plurality of sub-pictures; and
a memory coupled to the processor and configured to store the bitstream.

### Claim 14 (depends on 13)

The encoder of claim 13, wherein the bitstream further comprises a SEI message, and wherein the SEI message comprises the sub-picture level indicators.

### Claim 15 (depends on 13)

The encoder of claim 13, wherein the sub-picture level indicators indicate sub-picture pixel count.

### Claim 16 (depends on 13)

The encoder of claim 13, wherein the sub-picture level indicators further indicate the sub-picture size.

### Claim 17 (depends on 13)

The encoder of claim 13, wherein the sub-picture position includes an offset distance between a top-left sample of a sub-picture and a top-left sample of the picture.

### Claim 18 (depends on 13)

The encoder of claim 13, wherein the first sub-picture level indicators are an array that contains level identifiers indicating a level for each sequence extracted from each sub-picture.