# US 2022/0279178 A1 · Restrictions on adaptive-loop filtering parameter sets

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0279178 A1
- Document ID: US20220279178A1
- Status: Published application
- Kind: A1
- Application number: 17/748,687
- Filed: 2022-05-19
- Published: 2022-09-01
- Earliest claimed: 2019-03-23
- Assignees: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Applicants: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Inventors: Li ZHANG; Kai ZHANG; Hongbin LIU; Jizheng XU; Yue WANG
- Web page: https://patentgrep.com/patent/US20220279178A1

## CPC

- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/31: in the temporal domain
- H04N 19/463: by compressing encoding parameters before transmission
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/82: involving filtering within a prediction loop
- H04N 19/98: Adaptive-dynamic-range coding [ADRC]
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Devices, systems and methods for digital video coding, which includes in-loop reshaping for video coding, are described. An exemplary method for video processing includes performing a conversion between a video comprising one or more video data units and a bitstream representation of the video, the bitstream representation conforming to a format rule that specifies an inclusion of side information indicative of default parameters for a coding mode that is applicable to a video block of the one or more video data units for which the coding mode is enabled, and the side information providing parameters for constructing the video block based on a representation of the video block in an original domain and a reshaped domain and/or a luma-dependent scaling of a chroma residue of a chroma video block.

## Claims

### Claim 1

A method of processing video data, comprising:
performing a conversion between a first video data unit with a first temporal layer index of a video and a bitstream of the video,
wherein a first coding tool is applicable to a first video block of the first video data unit, wherein the first coding tool comprises, based on a first side information related to the first coding tool, processing the first video block based on a filtering process using adaptive loop filter coefficients, and
wherein the first side information is determined based on one or more first adaptation parameter sets for the first coding tool, and wherein the one or more first adaptation parameter sets are associated with a second temporal layer index which is less than or equal to the first temporal layer index,
wherein a second coding tool is conditionally applied to the first video date unit, wherein in response to applying the second coding tool during the conversion, at least one of a mapping process or a scaling process is applied to a second video block of the first video date unit based on a second side information related to the second coding tool,
wherein the second side information is determined based on one or more second adaptation parameter sets for the second coding tool, and wherein the one or more second adaptation parameter sets are associated with a third temporal layer index which is less than or equal to the first temporal layer index,
wherein in the mapping process, a piecewise linear model is used for a luma component of the second video block, and in the scaling process, residual samples of a chroma component of the second video block are scaled,
wherein the one or more first adaptation parameter sets and the one or more second adaptation parameter sets include a syntax element indicating a type of adaptation parameter set parameters, and
wherein the one or more first adaptation parameter sets and the one or more second adaptation parameter sets are allowed to be shared across pictures of the video.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first video data unit comprises a tile group, a tile, a picture, a slice, or a coding tree unit.

### Claim 3 (depends on 1)

The method of claim 1, wherein the type of adaptation parameter set parameters has predefined values.

### Claim 4 (depends on 1)

The method of claim 1, wherein scale coefficients of the piecewise linear model is determined base on first variables which are determined base on syntax elements included in the one or more second adaptation parameter sets and a second variable which is determined base on a bit depth.

### Claim 5 (depends on 1)

The method of claim 1, wherein information of the third temporal layer index and the second side information is present in a same information unit.

### Claim 6 (depends on 1)

The method of claim 1, wherein an identifier for the one or more second adaptation parameter sets to be utilized for the second video block is conditionally included in a header of the first video date unit.

### Claim 7 (depends on 1)

The method of claim 1, wherein the mapping process comprises at least one of a first mapping operation in which prediction luma samples of the luma component are converted from an original domain to a reshaped domain to generate modified prediction luma samples, or a second mapping operation which is an inverse operation of the first mapping operation to convert reconstructed samples of the luma component in the reshaped domain to the original domain.

### Claim 8 (depends on 1)

The method of claim 1, wherein the conversion includes encoding the first video data unit into the bitstream.

### Claim 9 (depends on 1)

The method of claim 1, wherein the conversion includes decoding the first video data unit from the bitstream.

### Claim 10

An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
perform a conversion between a first video data unit with a first temporal layer index of a video and a bitstream of the video,
wherein a first coding tool is applicable to a first video block of the first video data unit, wherein the first coding tool comprises, based on a first side information related to the first coding tool, processing the first video block based on a filtering process using adaptive loop filter coefficients, and
wherein the first side information is determined based on one or more first adaptation parameter sets for the first coding tool, and wherein the one or more first adaptation parameter sets are associated with a second temporal layer index which is less than or equal to the first temporal layer index,
wherein a second coding tool is conditionally applied to the first video date unit, wherein in response to applying the second coding tool during the conversion, at least one of a mapping process or a scaling process is applied to a second video block of the first video date unit based on a second side information related to the second coding tool,
wherein the second side information is determined based on one or more second adaptation parameter sets for the second coding tool, and wherein the one or more second adaptation parameter sets are associated with a third temporal layer index which is less than or equal to the first temporal layer index,
wherein in the mapping process, a piecewise linear model is used for a luma component of the second video block, and in the scaling process, residual samples of a chroma component of the second video block are scaled,
wherein the one or more first adaptation parameter sets and the one or more second adaptation parameter sets include a syntax element indicating a type of adaptation parameter set parameters, and
wherein the one or more first adaptation parameter sets and the one or more second adaptation parameter sets are allowed to be shared across pictures of the video.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the first video data unit comprises a tile group, a tile, a picture, a slice, or a coding tree unit.

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein the type of adaptation parameter set parameters has predefined values.

### Claim 13 (depends on 10)

The apparatus of claim 10, wherein scale coefficients of the piecewise linear model is determined base on first variables which are determined base on syntax elements included in the one or more second adaptation parameter sets and a second variable which is determined base on a bit depth.

### Claim 14 (depends on 10)

The apparatus of claim 10, wherein information of the third temporal layer index and the second side information is present in a same information unit.

### Claim 15 (depends on 10)

The apparatus of claim 10, wherein an identifier for the one or more second adaptation parameter sets to be utilized for the second video block is conditionally included in a header of the first video date unit.

### Claim 16

A non-transitory computer-readable storage medium storing instructions that cause a processor to:
perform a conversion between a first video data unit with a first temporal layer index of a video and a bitstream of the video,
wherein a first coding tool is applicable to a first video block of the first video data unit, wherein the first coding tool comprises, based on a first side information related to the first coding tool, processing the first video block based on a filtering process using adaptive loop filter coefficients, and
wherein the first side information is determined based on one or more first adaptation parameter sets for the first coding tool, and wherein the one or more first adaptation parameter sets are associated with a second temporal layer index which is less than or equal to the first temporal layer index,
wherein a second coding tool is conditionally applied to the first video date unit, wherein in response to applying the second coding tool during the conversion, at least one of a mapping process or a scaling process is applied to a second video block of the first video date unit based on a second side information related to the second coding tool,
wherein the second side information is determined based on one or more second adaptation parameter sets for the second coding tool, and wherein the one or more second adaptation parameter sets are associated with a third temporal layer index which is less than or equal to the first temporal layer index,
wherein in the mapping process, a piecewise linear model is used for a luma component of the second video block, and in the scaling process, residual samples of a chroma component of the second video block are scaled,
wherein the one or more first adaptation parameter sets and the one or more second adaptation parameter sets include a syntax element indicating a type of adaptation parameter set parameters, and
wherein the one or more first adaptation parameter sets and the one or more second adaptation parameter sets are allowed to be shared across pictures of the video.

### Claim 17 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the type of adaptation parameter set parameters has predefined values.

### Claim 18 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein scale coefficients of the piecewise linear model is determined base on first variables which are determined base on syntax elements included in the one or more second adaptation parameter sets and a second variable which is determined base on a bit depth.

### Claim 19 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein information of the third temporal layer index and the second side information is present in a same information unit.

### Claim 20

A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
generating the bitstream based on a first video data unit with a first temporal layer index of the video;
wherein a first coding tool is applicable to a first video block of the first video data unit, wherein the first coding tool comprises, based on a first side information related to the first coding tool, processing the first video block based on a filtering process using adaptive loop filter coefficients, and
wherein the first side information is determined based on one or more first adaptation parameter sets for the first coding tool, and wherein the one or more first adaptation parameter sets are associated with a second temporal layer index which is less than or equal to the first temporal layer index,
wherein a second coding tool is conditionally applied to the first video date unit, wherein in response to applying the second coding tool during the conversion, at least one of a mapping process or a scaling process is applied to a second video block of the first video date unit based on a second side information related to the second coding tool,
wherein the second side information is determined based on one or more second adaptation parameter sets for the second coding tool, and wherein the one or more second adaptation parameter sets are associated with a third temporal layer index which is less than or equal to the first temporal layer index,
wherein in the mapping process, a piecewise linear model is used for a luma component of the second video block, and in the scaling process, residual samples of a chroma component of the second video block are scaled,
wherein the one or more first adaptation parameter sets and the one or more second adaptation parameter sets include a syntax element indicating a type of adaptation parameter set parameters, and
wherein the one or more first adaptation parameter sets and the one or more second adaptation parameter sets are allowed to be shared across pictures of the video.