# US 12,015,789 B2 · Encoding device, decoding device and program for triangle merge protection on boundary between two blocks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,015,789 B2
- Document ID: US12015789B2
- Status: Granted
- Kind: B2
- Application number: 17/681,296
- Filed: 2022-02-25
- Published: 2022-06-09
- Granted: 2024-06-18
- Earliest claimed: 2019-08-29
- Assignees: Nippon Hoso Kyokai
- Applicants: Nippon Hoso Kyokai
- Inventors: Shunsuke Iwamura; Atsuro Ichigaya; Shimpei Nemoto
- Web page: https://patentgrep.com/patent/US12015789B2

## CPC

- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/124: Quantisation
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/513: Processing of motion vectors
- H04N 19/61: in combination with predictive coding
- H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- H04N 19/577: Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An encoding device 1 includes: a merge predictor 181a configured to generate area prediction images using motion vectors of a plurality of divided areas obtained by dividing an encoding-target block and merge areas at boundaries of a plurality of the generated area prediction images through weighted averaging to generate a prediction block of the encoding-target block: and a filter controller 161 configured to control the deblocking filter based on a position of a merged area merged by the merge predictor 181a through the weighted averaging.

## Claims

### Claim 1

An encoding device that performs encoding on each of blocks obtained by dividing an image, the encoding device comprising:
a merge predictor circuitry configured to generate area prediction images of a plurality of divided areas obtained by dividing an encoding-target block and merge areas at boundaries of a plurality of the generated area prediction images through weighted averaging to generate a prediction block of the encoding-target block;
a transformer/quantizer circuitry configured to perform a transform process and a quantization process on a prediction residual that represents a difference between the encoding-target block and the prediction block;
an inverse quantizer/inverse transformer circuitry configured to restore the prediction residual by performing an inverse quantization process and an inverse transform process on transform coefficients obtained by the transformer/quantizer;
a combiner circuitry configured to combine the restored prediction residual and the prediction block to reconstruct the encoding-target block;
a deblocking filter circuitry configured to perform a filter process on a block boundary between two blocks including the reconstructed encoding-target block and an adjacent block adjacent to the encoding-target block; and
a filter controller circuitry configured to control the deblocking filter based on a position of a merged area merged by the merge predictor through the weighted averaging, wherein
the deblocking filter is configured to perform the filter process in units of two sub-blocks across the block boundary, and
the filter controller is configured to control the deblocking filter such that the filter process is performed on a sub-block boundary in response to the sub-block boundary between the two sub-blocks being adjacent to the merged area.

### Claim 2 (depends on 1)

The encoding device according to claim 1, wherein
when the sub-block boundary is not adjacent to the merged area, the filter controller is configured to control whether or not the filter process is performed on the sub-block boundary based on at least one of whether or not a non-zero transform coefficient exists in each of the two sub-blocks or information regarding motion vectors of the two sub-blocks.

### Claim 3

A decoding device that performs decoding on each of blocks obtained by dividing an image, the decoding device comprising:
an entropy decoder circuitry configured to output transform coefficients corresponding to a decoding-target block by decoding an encoded stream;
an inverse quantizer/inverse transformer circuitry configured to restore a prediction residual by performing an inverse quantization process and an inverse transform process on the transform coefficients outputted by the entropy decoder;
a merge predictor circuitry configured to generate area prediction images of a plurality of divided areas obtained by dividing the decoding-target block and merge areas at boundaries of a plurality of the generated area prediction images through weighted averaging to generate a prediction block of the decoding-target block;
a combiner circuitry configured to combine the restored prediction residual and the prediction block to reconstruct the decoding-target block;
a deblocking filter circuitry configured to perform a filter process on a block boundary between two blocks including the reconstructed decoding-target block and an adjacent block adjacent to the decoding-target block; and
a filter controller circuitry configured to control the deblocking filter based on a position of a merged area merged by the merge predictor through the weighted averaging, wherein
the deblocking filter is configured to perform the filter process in units of two sub-blocks across the block boundary, and
the filter controller is configured to control the deblocking filter such that the filter process is performed on a sub-block boundary in response to the sub-block boundary between the two sub-blocks being adjacent to the merged area.

### Claim 4 (depends on 3)

The decoding device according to claim 3, wherein
when the sub-block boundary is not adjacent to the merged area, the filter controller is configured to control whether or not the filter process is performed on the sub-block boundary based on at least one of whether or not a non-zero transform coefficient exists in each of the two sub-blocks or information regarding motion vectors of the two sub-blocks.

### Claim 5 (depends on 1)

A non-transitory computer readable storage medium storing a program causing a computer to function as the encoding device according to claim 1.

### Claim 6 (depends on 3)

A non-transitory computer readable storage medium storing a program causing a computer to function as the decoding device according to claim 3.
