# US 2015/0103920 A1 · Indication of parallel processing in video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0103920 A1
- Document ID: US20150103920A1
- Status: Published application
- Kind: A1
- Application number: 14/512,199
- Filed: 2014-10-10
- Published: 2015-04-16
- Earliest claimed: 2013-10-14
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Krishnakanth Rapaka; Ye-Kui Wang; Fnu Hendry
- Web page: https://patentgrep.com/patent/US20150103920A1

## CPC

- H04N 19/37: with arrangements for assigning different transmission priorities to video input data or to video coded data
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/436: using parallelised computational arrangements
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In an example, a method of decoding video data includes decoding, from a video parameter set (VPS) of a multi-layer bitstream, data that indicates at least one of a tile configuration for layers of the multi-layer bitstream or a parallel processing configuration for layers of the multi-layer bitstream. The method also includes decoding the multi-layer bitstream in accordance with the data decoded from the VPS.

## Claims

### Claim 1

A method of decoding video data, the method comprising:
decoding, from a video parameter set (VPS) of a multi-layer bitstream, data that indicates at least one of a tile configuration for layers of the multi-layer bitstream or a parallel processing configuration for layers of the multi-layer bitstream; and
decoding the multi-layer bitstream in accordance with the data decoded from the VPS.

### Claim 2 (depends on 1)

The method of claim 1, wherein decoding the data that indicates the tile configuration comprises decoding, for each layer of the multi-layer bitstream, data that indicates whether tiles are enabled for the respective layer of the multi-layer bitstream.

### Claim 3 (depends on 2)

The method of claim 2, wherein decoding the data that indicates the tile configuration further comprises decoding a tiles_enabled_vps_flag syntax element that indicates the tile configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 4 (depends on 3)

The method of claim 3, wherein decoding the data that indicates the tile configuration further comprises decoding a loop_filter_across_tiles_disabled_vps_flag syntax element that indicates a loop filter configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 5 (depends on 1)

The method of claim 1, wherein decoding the data that indicates the parallel processing configuration comprises decoding, for each layer of the multi-layer bitstream, data that indicates whether entropy coding synchronization is performed for the respective layer of the multi-layer bitstream.

### Claim 6 (depends on 5)

The method of claim 5, wherein decoding the data that indicates the parallel processing configuration further comprises decoding an entropy_coding_sync_enabled_vps_flag syntax element that indicates the parallel processing configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 7 (depends on 1)

The method of claim 1, wherein the data that indicates the tile configuration and the parallel processing configuration includes a parallel_tools_vps_idc syntax element, wherein the parallel_tools_vps_idc syntax element indicates both the tile configuration and the parallel processing configuration for each layer of the video data.

### Claim 8 (depends on 1)

The method of claim 1, wherein the data that indicates the tile configuration and the parallel processing configuration includes a tile_entropy_sync_coding_not_mixed_flag syntax element and a loopfilter_across_tile_boundary_not_mixed_flag syntax element, wherein the tile_entropy_sync_coding_not_mixed_flag syntax element indicates the tile configuration and the parallel processing configuration for each layer of video data, and wherein the loopfilter_across_tile_boundary_not_mixed_flag syntax element indicates the loop filter configuration for each layer of video data.

### Claim 9 (depends on 1)

The method of claim 1, further comprising assigning decoding resources of a video decoder based on the data decoded from the VPS.

### Claim 10 (depends on 1)

The method of claim 1, wherein decoding the VPS comprises decoding the VPS prior to a sequence of pictures of the multi-layer bitstream, and wherein decoding the multi-layer bitstream comprises decoding the sequence of pictures in accordance with the data decoded from the VPS.

### Claim 11

A method of encoding video data, the method comprising:
encoding, in a video parameter set (VPS) of a multi-layer bitstream, data that indicates at least one of a tile configuration for layers of the multi-layer bitstream or a parallel processing configuration for layers of the multi-layer bitstream; and
encoding the multi-layer bitstream including encoding the VPS of the multi-layer bitstream.

### Claim 12 (depends on 11)

The method of claim 11, wherein encoding the data that indicates the tile configuration comprises encoding, for each layer of the multi-layer bitstream, data that indicates whether tiles are enabled for the respective layer of the multi-layer bitstream.

### Claim 13 (depends on 12)

The method of claim 12, wherein encoding the data that indicates the tile configuration further comprises encoding a tiles_enabled_vps_flag syntax element that indicates the tile configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 14 (depends on 13)

The method of claim 13, wherein encoding the data that indicates the tile configuration further comprises encoding a loop_filter_across_tiles_disabled_vps_flag syntax element that indicates a loop filter configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 15 (depends on 11)

The method of claim 11, wherein encoding the data that indicates the parallel processing configuration comprises encoding, for each layer of the multi-layer bitstream, data that indicates whether entropy coding synchronization is performed for the respective layer of the multi-layer bitstream.

### Claim 16 (depends on 15)

The method of claim 15, wherein encoding the data that indicates the parallel processing configuration further comprises encoding an entropy_coding_sync_enabled_vps_flag syntax element that indicates the parallel processing configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 17 (depends on 11)

The method of claim 11, wherein the data that indicates the tile configuration and the parallel processing configuration includes a parallel_tools_vps_idc syntax element, wherein the parallel_tools_vps_idc syntax element indicates both the tile configuration and the parallel processing configuration for each layer of the video data.

### Claim 18 (depends on 11)

The method of claim 11, wherein the data that indicates the tile configuration and the parallel processing configuration includes a tile_entropy_sync_coding_not_mixed_flag syntax element and a loopfilter_across_tile_boundary_not_mixed_flag syntax element, wherein the tile_entropy_sync_coding_not_mixed_flag syntax element indicates the tile configuration and the parallel processing configuration for each layer of video data, and wherein the loopfilter_across_tile_boundary_not_mixed_flag syntax element indicates the loop filter configuration for each layer of video data.

### Claim 19 (depends on 11)

The method of claim 11, further comprising assigning encoding resources of a video encoder in accordance with the data of the VPS.

### Claim 20 (depends on 11)

The method of claim 11, wherein encoding the VPS comprises encoding the VPS prior to encoding a sequence of pictures of the multi-layer bitstream, and wherein encoding the multi-layer bitstream comprises encoding the sequence of pictures.

### Claim 21

An apparatus that processes video data, the apparatus comprising:
a memory storing multi-layer video data; and
a video coder configured to:
process data that indicates at least one of a tile configuration for layers of the multi-layer video data or a parallel processing configuration for layers of the multi-layer video data, wherein the data is associated with a video parameter set (VPS) of a bitstream that includes the multi-layer video data; and
process the multi-layer video data in accordance with the data of the VPS.

### Claim 22 (depends on 21)

The apparatus of claim 21, wherein to process the data that indicates the tile configuration, the video coder is configured to process, for each layer of the multi-layer video data, data that indicates whether tiles are enabled for the respective layer of the multi-layer video data.

### Claim 23 (depends on 22)

The apparatus of claim 22, wherein to process the data that indicates the tile configuration, the video coder is further configured to process a tiles_enabled_vps_flag syntax element that indicates the tile configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 24 (depends on 23)

The apparatus of claim 23, wherein to process the data that indicates the tile configuration, the video coder is further configured to process a loop_filter_across_tiles_disabled_vps_flag syntax element that indicates a loop filter configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 25 (depends on 21)

The apparatus of claim 21, wherein to process the data that indicates the parallel processing configuration, the video coder is configured to process, for each layer of the multi-layer video data, data that indicates whether entropy coding synchronization is performed for the respective layer of the multi-layer video data.

### Claim 26 (depends on 25)

The apparatus of claim 25, wherein to process the data that indicates the parallel processing configuration, the video coder is further configured to process an entropy_coding_sync_enabled_vps_flag syntax element that indicates the parallel processing configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 27 (depends on 21)

The apparatus of claim 21, wherein to process the video data, the video coder is configured to encode the video data, comprising:
determine residual video data for at least one layer of the multi-layer video data;
transform the residual data; and
encode data representing the transformed residual data in the bitstream.

### Claim 28 (depends on 21)

The apparatus of claim 21, wherein to process the video data, the video coder is configured to decode the video data, comprising:
parse the VPS of the bitstream;
parse, after parsing the VPS and from the bitstream, data representing residual video data for at least one layer of the multi-layer bitstream;
inverse transform the residual data; and
reconstruct the at least one layer of video data based on the inverse transformed residual data.

### Claim 29 (depends on 21)

The apparatus of claim 21, further comprising a display device configured to present at least one layer of the multi-layer video data.

### Claim 30 (depends on 21)

The apparatus of claim 21, further comprising a wireless modem configured to receive the multi-layer video data.

### Claim 31

An apparatus that performs video data, the apparatus comprising:
means for processing data that indicates at least one of a tile configuration for layers of the multi-layer bitstream or a parallel processing configuration for layers of the multi-layer bitstream, wherein the data is associated with a video parameter set (VPS) of the multi-layer bitstream; and
means for processing the multi-layer bitstream in accordance with the data of the VPS.

### Claim 32 (depends on 31)

The apparatus of claim 31, wherein the means for processing the data that indicates the tile configuration comprises a means for processing, for each layer of the multi-layer bitstream, data that indicates whether tiles are enabled for the respective layer of the multi-layer bitstream.

### Claim 33 (depends on 32)

The apparatus of claim 32, wherein the means for processing the data that indicates the tile configuration further comprises a means for processing a tiles_enabled_vps_flag syntax element that indicates the tile configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 34 (depends on 33)

The apparatus of claim 33, wherein the means for processing the data that indicates the tile configuration further comprises means for processing a loop_filter_across_tiles_disabled_vps_flag syntax element that indicates a loop filter configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 35 (depends on 31)

The apparatus of claim 31, wherein the means for processing the data that indicates the parallel processing configuration comprises means for processing, for each layer of the multi-layer bitstream, data that indicates whether entropy coding synchronization is performed for the respective layer of the multi-layer bitstream.

### Claim 36 (depends on 35)

The apparatus of claim 35, wherein the means for processing the data that indicates the parallel processing configuration further comprises means for processing an entropy_coding_sync_enabled_vps_flag syntax element that indicates the parallel processing configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 37

A non-transitory computer-readable storage medium having instructions stored thereon that, when executed, cause one or more processors to:
process data that indicates at least one of a tile configuration for layers of the multi-layer bitstream or a parallel processing configuration for layers of the multi-layer bitstream, wherein the data is associated with a video parameter set (VPS) of the multi-layer bitstream; and
process the multi-layer bitstream in accordance with the data of the VPS.

### Claim 38 (depends on 37)

The non-transitory computer-readable storage medium of claim 37, wherein to process the data that indicates the tile configuration, the instructions cause the one or more processors to process, for each layer of the multi-layer bitstream, data that indicates whether tiles are enabled for the respective layer of the multi-layer bitstream.

### Claim 39 (depends on 38)

The non-transitory computer-readable storage medium of claim 38, wherein to process the data that indicates the tile configuration, the instructions further cause the one or more processors to process a tiles_enabled_vps_flag syntax element that indicates the tile configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 40 (depends on 39)

The non-transitory computer-readable storage medium of claim 39, wherein to process the data that indicates the tile configuration, the instructions further cause the one or more processors to process a loop_filter_across_tiles_disabled_vps_flag syntax element that indicates a loop filter configuration for each picture parameter set referred to by at least one picture of the respective layer.

### Claim 41 (depends on 37)

The non-transitory computer-readable storage medium of claim 37, wherein to process the data that indicates the parallel processing configuration, the instructions cause the one or more processors to process, for each layer of the multi-layer bitstream, data that indicates whether entropy coding synchronization is performed for the respective layer of the multi-layer bitstream.

### Claim 42 (depends on 41)

The non-transitory computer-readable storage medium of claim 41, wherein to process the data that indicates the parallel processing configuration, the instructions further cause the one or more processors to process an entropy_coding_sync_enabled_vps_flag syntax element that indicates the parallel processing configuration for each picture parameter set referred to by at least one picture of the respective layer.
