# US 2022/0286692 A1 · Video encoding and decoding using differential encoding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0286692 A1
- Document ID: US20220286692A1
- Status: Published application
- Kind: A1
- Application number: 17/637,734
- Filed: 2020-08-27
- Published: 2022-09-08
- Earliest claimed: 2019-08-27
- Assignees: Hyundai Motor Company; Kia Corporation; Ewha University-Industry Collaboration Foundation
- Applicants: Hyundai Motor Company; Kia Corporation; Ewha University - Industry Collaboration Foundation
- Inventors: Je Won Kang; Seung Wook Park; Wha Pyeong Lim
- Web page: https://patentgrep.com/patent/US20220286692A1

## CPC

- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/124: Quantisation
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/593: involving spatial prediction techniques
- H04N 19/61: in combination with predictive coding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Video encoding and decoding methods are configured to apply differential coding to residual signals to enhance compression performance in a transform skip mode, and methods of controlling the differential coding are configured at a high-level and at a block-level.

## Claims

### Claim 1

A method for decoding a bitstream generated by encoding a video sequence of a plurality of pictures, the method comprising:
decoding, from a sequence parameter set of the bitstream, information on a chroma sampling format and high-level syntax elements related to differential encoding of residual signals, the high-level syntax elements comprising a single common control flag indicating whether the differential encoding is enabled for the residual signals of each of luma and chroma components of the video sequence, and information on a maximum block size allowed for the differential encoding;
if a target block to be currently decoded satisfies conditions defined by the information on the chroma sampling format and the high-level syntax elements, decoding a first chroma syntax element indicating whether the differential encoding is applied to a chroma block corresponding to the target block or not, and decoding a second chroma syntax element indicating a differential encoding direction applied to the chroma block based on the first chroma syntax element;
reconstructing a residual block of the chroma block from the bitstream; and
reconstructing the chroma block by modifying the residual signals within the residual block according to the differential encoding direction indicated by the second chroma syntax element.

### Claim 2 (depends on 1)

The method of claim 1, wherein the conditions defined by the information on the chroma sampling format and the high-level syntax elements are satisfied when:
the common control flag indicates that the differential encoding is enabled for both of the luma and chroma components of the video sequence,
the value obtained by dividing the width of the target block by a horizontal scaling factor determined by the chroma sampling format is smaller than or equal to a horizontal threshold indicated by the information on the maximum block size, and
the value obtained by dividing the height of the target block by a vertical scaling factor determined by the chroma sampling format is smaller than or equal to a vertical threshold indicated by the information on the maximum block size.

### Claim 3 (depends on 1)

The method of claim 1, wherein the reconstructing of the chroma block comprises:
generating a modified residual block by modifying a target residual signal to be modified within the residual block in such a manner that one or more residual signals within the residual block, which are arranged in a direction indicated by the second chroma syntax element from the target residual signal, are added to the target residual signal;
inversely quantizing the modified residual block and skipping inverse transform for the inversely quantized residual block;
generating a prediction block for the chroma block, by using an intra prediction mode having the same direction as the differential encoding direction indicated by the second syntax element without decoding intra prediction information for the chroma block; and
reconstructing the chroma block by adding the prediction block and the inversely quantized residual block.

### Claim 4 (depends on 3)

The method of claim 3, wherein, when the second chroma syntax element indicates a horizontal direction, the target residual signal is modified in such a manner that left residual signals positioned to the left of the target residual signal in the same row as the target residual signal is added to the target residual signal.

### Claim 5 (depends on 3)

The method of claim 3, wherein, when the second chroma syntax element indicates a vertical direction, the target residual signal is modified in such a manner that upper residual signals positioned above the target residual signal in the same column as the target residual signal is added to the target residual signal.

### Claim 6 (depends on 1)

The method of claim 1, wherein the information on the maximum block size allowed for the differential encoding is information on a maximum transform size up to which transform skip is allowed.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
if the target block satisfies conditions defined by the high-level syntax elements, decoding a first luma syntax element indicating whether the differential encoding is applied to a luma block corresponding to the target block or not, and decoding a second luma syntax element indicating a differential encoding direction applied to the luma block based on the first luma syntax element;
reconstructing a residual block of the luma block from the bitstream; and
reconstructing the luma block by modifying the residual signals within the residual block of the luma block according to the differential encoding direction indicated by the second luma syntax element.

### Claim 8 (depends on 7)

The method of claim 7, wherein the conditions defined by the high-level syntax elements are satisfied when:
the common control flag indicates that the differential encoding is enabled for both of the luma and chroma components of the video sequence,
the width of the target block is smaller than or equal to a horizontal threshold indicated by the information on the maximum block size, and
the height of the target block is smaller than or equal to a vertical threshold indicated by the information on the maximum block size.

### Claim 9

An apparatus for decoding a bitstream with an encoded video sequence of a plurality of pictures, the apparatus comprising:
a decoder configure to extract information from the bitstream; and
a reconstructor configured to reconstruct a target block to be currently decoded based on the extracted information,
wherein the decoder is configured to:
decode, from a sequence parameter set of the bitstream, high-level syntax elements comprising a single common control flag indicating whether differential encoding is enabled for residual signals of each of luma and chroma components of the video sequence, and information on a maximum block size allowed for the differential encoding,
decode information on a chroma sampling format from the sequence parameter set, and
if the target block satisfies conditions defined by the high-level syntax elements and the information on the chroma sampling format, decode a first chroma syntax element indicating whether the differential encoding is applied to a chroma block corresponding to the target block or not, and decode a second chroma syntax element indicating a differential encoding direction applied to the chroma block based on the first chroma syntax element, and
reconstruct a residual block of the chroma block from the bitstream,
wherein, if the first chroma syntax element indicates that differential encoding is applied to the chroma block, the reconstructor is configured to reconstruct the chroma block by modifying the residual signals within the residual block according to the differential encoding direction indicated by the second chroma syntax element.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the conditions defined by the high-level syntax elements and the information on the chroma sampling format are satisfied when:
the common control flag indicates that the differential encoding is enabled for both of the luma and chroma components of the video sequence,
the value obtained by dividing the width of the target block by a horizontal scaling factor determined by the chroma sampling format is smaller than or equal to a horizontal threshold indicated by the information on the maximum block size, and
the value obtained by dividing the height of the target block by a vertical scaling factor determined by the chroma sampling format is smaller than or equal to a vertical threshold indicated by the information on the maximum block size.

### Claim 11 (depends on 9)

The apparatus of claim 9, wherein the reconstructor is configured to
generate a modified residual block by modifying a target residual signal to be modified within the residual block in such a manner that one or more residual signals within the residual block, which are arranged in a direction indicated by the second chroma syntax element from the target residual signal, are added to the target residual signal,
inversely quantize the modified residual block and skip inverse transform for the inversely quantized residual block,
generate a prediction block for the chroma block, by using an intra prediction mode having the same direction as the differential encoding direction indicated by the second syntax element, and
reconstruct the chroma block by adding the prediction block and the inversely quantized residual block.

### Claim 12

A method for encoding a video sequence of a plurality of pictures, the method comprising:
encoding, to a sequence parameter set of the bitstream, information on a chroma sampling format and high-level syntax elements related to differential encoding of residual signals, the high-level syntax elements comprising a single common control flag indicating whether the differential encoding is enabled for the residual signals of each of luma and chroma components of the video sequence, and information on a maximum block size allowed for the differential encoding;
if a target block to be currently decoded satisfies conditions defined by the information on the chroma sampling format and the high-level syntax elements, encoding a first chroma syntax element indicating whether the differential encoding is applied to a chroma block corresponding to the target block or not, and encoding a second chroma syntax element indicating a differential encoding direction applied to the chroma block based on the first chroma syntax element; and
if the first chroma syntax element indicates that the differential encoding is applied to the chroma block, differentially encoding the residual signals for the chroma block according to the differential encoding direction indicated by the second chroma syntax element.

### Claim 13 (depends on 12)

The method of claim 12, wherein the conditions defined by the information on the chroma sampling format and the high-level syntax elements are satisfied when:
the common control flag indicates that the differential encoding is enabled for both of the luma and chroma components of the video sequence,
the value obtained by dividing the width of the target block by a horizontal scaling factor determined by the chroma sampling format is smaller than or equal to a horizontal threshold indicated by the information on the maximum block size, and
the value obtained by dividing the height of the target block by a vertical scaling factor determined by the chroma sampling format is smaller than or equal to a vertical threshold indicated by the information on the maximum block size.

### Claim 14 (depends on 12)

The method of claim 12, wherein the differential encoding comprises:
generating a prediction block for the chroma block, by using an intra prediction mode having the same direction as the differential encoding direction indicated by the second syntax element;
generating a residual block for the chroma block by subtracting the prediction block from the chroma block;
skipping transform of the residual block and quantizing the residual block; and
encoding a differential value between adjacent residual signals arranged in the differential encoding direction indicated by the second syntax element within the quantized residual block,
wherein information on the intra prediction mode for the chroma block is not encoded.

### Claim 15 (depends on 12)

The method of claim 12, wherein the information on the maximum block size allowed for the differential encoding is information on a maximum transform size up to which transform skip is allowed.
