# US 12,010,346 B2 · Transform skip residual coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,010,346 B2
- Document ID: US12010346B2
- Status: Granted
- Kind: B2
- Application number: 17/968,958
- Filed: 2022-10-19
- Published: 2023-03-02
- Granted: 2024-06-11
- Earliest claimed: 2020-04-19
- Assignees: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Applicants: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Inventors: Ye-Kui Wang; Li Zhang; Kai Zhang; Zhipin Deng
- Web page: https://patentgrep.com/patent/US12010346B2

## CPC

- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/60: using transform coding
- H04N 19/33: in the spatial domain
- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Several techniques for video encoding and video decoding are described. One example method includes performing a conversion between a block of a video and a bitstream of the video according to a rule. The rule specifies that whether a syntax flag indicating whether transform skip residual coding is enabled at a video unit level is present in the bitstream is based on values of a first syntax element indicating usage of sign data hiding in the video unit and a second syntax element indicating usage of dependent quantization in the video unit.

## Claims

### Claim 1

A method for processing video data, comprising:
performing a conversion between a video comprising one or more video units and a bitstream of the video according to a rule,
wherein the rule specifies that a syntax flag related to transform skip residual coding is conditionally included in the bitstream at a video unit level based on values of a first syntax element indicating usage of sign data hiding at the video unit level and a second syntax element indicating usage of dependent quantization at the video unit level,
wherein whether the syntax flag is included in the bitstream is further based on a third syntax element in a sequence parameter set indicating whether transform skip is allowed at a sequence level, and
wherein the syntax flag is present in case a value of the third syntax element specifies that the transform skip is allowed at the sequence level, a value of the second syntax element specifies that the dependent quantization is not used for a video unit from the one or more video units, and a value of the first syntax element specifies that the sign data hiding is not used for the video unit.

### Claim 2 (depends on 1)

The method of claim 1, wherein a video unit from the one or more video units is a slice, and the video unit level corresponds to a slice level, and
wherein the syntax flag is represented as ts_residual_coding_disabled_flag in a slice header.

### Claim 3 (depends on 1)

The method of claim 1, wherein the third syntax element is represented as sps_transform_skip_enabled_flag in the sequence parameter set,
wherein the value of the third syntax element specifying that the transform skip is allowed at the sequence level is equal to 1, the value of the second syntax element specifying that the dependent quantization is not used for a video unit from the one or more video units is equal to 0, and the value of the first syntax element specifying that the sign data hiding is not used for the video unit is equal to 0,
wherein the first syntax element indicating the usage of the sign data hiding in the video unit has a default value of 0 in case the first syntax element is not present, and wherein the second syntax element indicating the usage of the dependent quantization in the video unit has a default value of 0 in case the second syntax element is not present.

### Claim 4 (depends on 1)

The method of claim 1, wherein the second syntax element is conditionally included in the bitstream based on a fourth syntax element in a sequence parameter set indicating whether the dependent quantization is enabled at a sequence level.

### Claim 5 (depends on 4)

The method of claim 4, wherein the first syntax element is conditionally included in the bitstream based on the fourth syntax element in a sequence parameter set indicating whether the sign data hiding is enabled at the sequence level and the second syntax element.

### Claim 6 (depends on 1)

The method of claim 1, wherein, in case transform skip is enabled, the sign data hiding and the dependent quantization are not applicable for a video unit from the one or more video units.

### Claim 7 (depends on 1)

The method of claim 1, wherein the transform skip residual coding is a transform coefficient coding technique applied for a video block which is coded with transform skip mode,
wherein the sign data hiding is a technique that omits coding of a coefficient sign flag, or
wherein the dependent quantization is a mode in which quantization of a sample depends on state of previous samples.

### Claim 8 (depends on 1)

The method of claim 1, wherein the video comprises a video picture, and
wherein the rule further specifies that at least one of scaling window offsets applicable to the video picture is no less than X, where X is a negative integer value determined based on a dimension of the video picture,
wherein the scaling window offsets comprises at least one of a scaling window right offset, a scaling window left offset, a scaling window top offset, or a scaling window bottom offset, and wherein the dimension of the video picture comprises a picture width represented in luma samples or a picture height represented in luma samples.

### Claim 9 (depends on 8)

The method of claim 8, wherein a value of SubWidthC*(scaling_win_left_offset+scaling_win_right_offset) is less than the picture width represented in luma samples, and a value of SubHeightC*(scaling_win_top_offset+scaling_win_bottom_offset) is less than the picture height represented in luma samples, where scaling_win_left_offset denotes the scaling window left offset, scaling_win_right_offset denotes the scaling window right offset, scaling_win_top_offset denotes the scaling window top offset, scaling_win_bottom_offset denotes the scaling window bottom offset, and SubWidthC and SubHeightC are determined based on a chroma format of the video picture.

### Claim 10 (depends on 1)

The method of claim 1, wherein the rule specifies that a type of an adaptation parameter set is indicated prior to an identifier of the adaptation parameter set.

### Claim 11 (depends on 1)

The method of claim 1, wherein the conversion includes encoding the video into the bitstream.

### Claim 12 (depends on 1)

The method of claim 1, wherein the conversion includes decoding the video from the bitstream.

### Claim 13

An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
perform a conversion between a video comprising one or more video units and a bitstream of the video according to a rule,
wherein the rule specifies that a syntax flag related to transform skip residual coding is conditionally included in the bitstream at a video unit level based on values of a first syntax element indicating usage of sign data hiding at the video unit level and a second syntax element indicating usage of dependent quantization at the video unit level,
wherein whether the syntax flag is included in the bitstream is further based on a third syntax element in a sequence parameter set indicating whether transform skip is allowed at a sequence level, and
wherein the syntax flag is present in case a value of the third syntax element specifies that the transform skip is allowed at the sequence level, a value of the second syntax element specifies that the dependent quantization is not used for a video unit from the one or more video units, and a value of the first syntax element specifies that the sign data hiding is not used for the video unit.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein a video unit from the one or more video units is a slice, and the video unit level corresponds to a slice level, and
wherein the syntax flag is represented as ts_residual_coding_disabled_flag in a slice header.

### Claim 15 (depends on 13)

The apparatus of claim 13,
wherein the third syntax element is represented as sps_transform_skip_enabled_flag in the sequence parameter set,
wherein the value of the third syntax element specifying that transform skip is allowed at the sequence level is equal to 1, the value of the second syntax element specifying that the dependent quantization is not used for the video unit is equal to 0, and the value of the first syntax element specifying that the sign data hiding is not used for the video unit is equal to 0,
wherein the first syntax element indicating the usage of the sign data hiding in the video unit has a default value of 0 in case the first syntax element is not present, and
wherein the second syntax element indicating the usage of the dependent quantization in the video unit has a default value of 0 in case the second syntax element is not present.

### Claim 16 (depends on 13)

The apparatus of claim 13, wherein the second syntax element is conditionally included in the bitstream based on a fourth syntax element in a sequence parameter set indicating whether the dependent quantization is enabled at a sequence level;
wherein the first syntax element is conditionally included in the bitstream based on the fourth syntax element in a sequence parameter set indicating whether the sign data hiding is enabled at the sequence level and the second syntax element.

### Claim 17 (depends on 13)

The apparatus of claim 13, wherein, in case transform skip is enabled, the sign data hiding and the dependent quantization is not applicable for a video unit from the one or more video units,
wherein the transform skip residual coding is a transform coefficient coding technique applied for a video block which is coded with transform skip mode,
wherein the sign data hiding is a technique that omits coding of a coefficient sign flag, or
wherein the dependent quantization is a mode in which quantization of a sample depends on state of previous samples, and
wherein the video comprises a video picture.

### Claim 18

A non-transitory computer-readable storage medium storing instructions that cause a processor to:
perform a conversion between a video comprising one or more video units and a bitstream of the video according to a rule,
wherein the rule specifies that a syntax flag related to transform skip residual coding is conditionally included in the bitstream at a video unit level based on values of a first syntax element indicating usage of sign data hiding at the video unit level and a second syntax element indicating usage of dependent quantization at the video unit level,
wherein whether the syntax flag is included in the bitstream is further based on a third syntax element in a sequence parameter set indicating whether transform skip is allowed at a sequence level, and
wherein the syntax flag is present in case a value of the third syntax element specifies that the transform skip is allowed at the sequence level, a value of the second syntax element specifies that the dependent quantization is not used for a video unit from the one or more video units, and a value of the first syntax element specifies that the sign data hiding is not used for the video unit.

### Claim 19

A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
generating the bitstream of the video comprising one or more video units according to a rule,
wherein the rule specifies that a syntax flag related to transform skip residual coding is conditionally included in the bitstream at a video unit level based on values of a first syntax element indicating usage of sign data hiding at the video unit level and a second syntax element indicating usage of dependent quantization at the video unit level,
wherein whether the syntax flag is included in the bitstream is further based on a third syntax element in a sequence parameter set indicating whether transform skip is allowed at a sequence level, and
wherein the syntax flag is present in case a value of the third syntax element specifies that the transform skip is allowed at the sequence level, a value of the second syntax element specifies that the dependent quantization is not used for a video unit from the one or more video units, and a value of the first syntax element specifies that the sign data hiding is not used for the video unit.
