# US 11,451,814 B2 · Image encoding method and device, and image decoding method and device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,451,814 B2
- Document ID: US11451814B2
- Status: Granted
- Kind: B2
- Application number: 17/475,832
- Filed: 2021-09-15
- Published: 2022-01-06
- Granted: 2022-09-20
- Earliest claimed: 2019-03-15
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Minsoo Park; Minwoo Park
- Web page: https://patentgrep.com/patent/US11451814B2

## CPC

- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- G06Q 10/06312: {Adjustment or analysis of established resource schedule, e.g. resource or task levelling, or dynamic rescheduling}
- G06Q 10/0637: Strategic management or analysis, e.g. setting a goal or target of an organisation; Planning actions based on goals; Analysis or evaluation of effectiveness of goals
- G06Q 10/0639: Performance analysis of employees; Performance analysis of enterprise or organisation operations
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/18: the unit being a set of transform coefficients
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/503: involving temporal prediction (adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109)
- H04N 19/619: {the transform being operated outside the prediction loop}
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/82: involving filtering within a prediction loop
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

An image decoding method may include determining whether at least one of a height and a width of a current coding unit is greater than a predetermined size, obtaining, based on whether the current coding unit is to be split into transform units, a second coded block flag from the bitstream, the second coded block flag indicating whether a block of a luma component included in the at least one transform unit includes at least one transform coefficient in the bitstream, obtaining a residual signal of the block of the luma component included in the at least one transform unit, based on the second coded block flag, reconstructing the current coding unit based on the residual signal, and reconstructing the current image including the current coding unit, based on the reconstructed current coding unit. The split shape mode may indicate at least one of whether to perform splitting, a split direction, and a split type, and the split type may correspond to binary splitting, tri splitting, and quad splitting.

## Claims

### Claim 1

An image decoding method comprising:
obtaining a plurality of largest coding units by splitting a current image based on a size information of a largest coding unit;
obtaining one or more coding units comprising a current coding unit, by hierarchically splitting at least one largest coding unit among the plurality of largest coding units, based on a split shape mode;
based on a prediction mode of the current coding unit being an inter mode, obtaining, from a bitstream, a first coded block flag indicating whether the current coding unit comprises one or more non-zero significant transform coefficients;
based on the first coded block flag indicating that the current coding unit comprises one or more non-zero significant transform coefficients, identifying whether at least one of a height and a width of the current coding unit is greater than a predetermined size;
based on whether the at least one of the height and the width of the current coding unit is greater than the predetermined size, obtaining at least one transform unit included in the current coding unit;
based on the at least one of the height and the width of the current coding unit being greater than the predetermined size, obtaining a second coded block flag from the bitstream, the second coded block flag indicating whether a block of a luma component included in the at least one transform unit comprises one or more non-zero significant transform coefficients;
based on the height and the width of the current coding unit being less than or equal to the predetermined size, identifying that the second coded block flag indicates that the block of the luma component included in the at least one transform unit comprises one or more non-zero significant transform coefficients;
obtaining a residual signal of the block of the luma component included in the at least one transform unit, based on the second coded block flag;
reconstructing the current coding unit based on the residual signal; and
reconstructing the current image comprising the current coding unit, based on the reconstructed current coding unit,
wherein the split shape mode indicates at least one of whether to perform splitting, a split direction, or a split type, and
wherein the split type corresponds to one of binary splitting, tri splitting, and quad splitting.

### Claim 2 (depends on 1)

The image decoding method of claim 1, wherein the obtaining of the first coded block flag from the bitstream comprises,
based on the prediction mode of the current coding unit being the inter mode and being neither a merge mode nor a skip mode, obtaining, from the bitstream, the first coded block flag indicating whether blocks of the luma component and chroma components included in the current coding unit comprise one or more non-zero significant transform coefficients, and
based on the prediction mode of the current coding unit being an intra mode, the first coded block flag about the current coding unit is not obtained from the bitstream, and the first coded block flag is identified as indicating that the blocks of the luma component and the chroma components included in the current coding unit comprise one or more non-zero significant transform coefficients in the bitstream.

### Claim 3 (depends on 1)

The image decoding method of claim 1, wherein, based on the first coded block flag indicating that the current coding unit comprises one or more non-zero significant transform coefficients in the bitstream, the identifying of whether the at least one of the height and the width of the current coding unit is greater than the predetermined size comprises identifying whether the height of the current coding unit is greater than a maximum transform unit size or the width of the current coding unit is greater than the maximum transform unit size.

### Claim 4 (depends on 1)

The image decoding method of claim 1, wherein the obtaining of the at least one transform unit included in the current coding unit based on whether the at least one of the height and the width of the current coding unit is greater than the predetermined size comprises, based on the at least one of the height and the width of the current coding unit being greater than the predetermined size, obtaining a plurality of transform units for which at least one of a height and a width has the predetermined size, from the current coding unit.

### Claim 5 (depends on 1)

The image decoding method of claim 1, wherein the obtaining of the first coded block flag from the bitstream comprises, based on the prediction mode of the current coding unit being the inter mode and being neither a merge mode nor a skip mode, obtaining the first coded block flag from the bitstream.

### Claim 6 (depends on 5)

The image decoding method of claim 5, wherein the obtaining the first coded block flag from the bitstream comprises, based on the prediction mode of the current coding unit being the inter mode, and being neither a merge mode nor a skip mode, and a tree type of the current coding unit corresponding to a single tree type, obtaining the first coded block flag from the bitstream.

### Claim 7 (depends on 1)

The image decoding method of claim 1, wherein the obtaining of the second coded block flag from the bitstream comprises, based on a tree type of the current coding unit corresponding to a single tree type or a dual-tree luma type, obtaining the second coded block flag from the bitstream.

### Claim 8 (depends on 1)

The image decoding method of claim 1, wherein the reconstructing of the current image comprising the current coding unit, based on the reconstructed current coding unit, further comprises, when the at least one of the height and the width of the current coding unit is greater than a predetermined second size, performing deblocking filtering on a predetermined boundary location in the current coding unit, the predetermined boundary location being determined based on the predetermined second size.

### Claim 9 (depends on 8)

The image decoding method of claim 8, wherein the performing of the deblocking filtering on the predetermined boundary location in the current coding unit, the predetermined boundary location being determined based on the predetermined second size, comprises obtaining a plurality of blocks for which at least one of a height and a width is a half of the predetermined second size, and performing deblocking filtering on a boundary of the plurality of blocks.

### Claim 10 (depends on 9)

The image decoding method of claim 9, wherein the performing of the deblocking filtering on the boundary of the plurality of blocks comprises:
when a type of an edge to which deblocking filtering is to be performed is a vertical edge, and the width of the current coding unit is greater than the predetermined second size, obtaining the plurality of blocks for which a width is a half of the width of the current coding unit, and performing the deblocking filtering on a vertical boundary of the plurality of blocks; and
when a type of an edge to which deblocking filtering is to be performed is a horizontal edge, and the height of the current coding unit is greater than the predetermined second size, obtaining the plurality of blocks for which a height is a half of the height of the current coding unit, and performing the deblocking filtering on a horizontal boundary of the plurality of blocks.

### Claim 11 (depends on 1)

A computer-readable recording medium having recorded thereon a program for implementing the method of claim 1.

### Claim 12 (depends on 1)

The image decoding method of claim 1, wherein
based on a size of the current coding unit being 128×128, a number of the at least one transform unit is 4, a size of four transform units is 64×64,
based on the size of the current coding unit being 128×N (N is a multiplier of 2 less than 64), a number of the at least one transform unit is 2, a size of two transform units is 64×N, and
based on the size of the current coding unit being N×128 (N is a multiplier of 2 less than 64), a number of the at least one transform unit is 2, a size of two transform units is N×64.