# US 12,120,346 B2 · Method and apparatus for boundary filtering for intrabc and intraTMP modes

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,120,346 B2
- Document ID: US12120346B2
- Status: Granted
- Kind: B2
- Application number: 17/980,316
- Filed: 2022-11-03
- Published: 2024-01-18
- Granted: 2024-10-15
- Earliest claimed: 2022-07-13
- Assignees: Tencent America LLC
- Applicants: Tencent America LLC
- Inventors: Xin Zhao; Guichun Li; Lien-fei Chen; Shan Liu
- Web page: https://patentgrep.com/patent/US12120346B2

## CPC

- H04N 19/593: involving spatial prediction techniques
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/167: Position within a video image, e.g. region of interest [ROI]
- H04N 19/172: the region being a picture, frame or field
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/80: Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence)
- H04N 19/82: involving filtering within a prediction loop
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method performed by a video decoder includes receiving a coded video bitstream that includes a current picture with at least one block located at a boundary of the current picture. The method includes determining whether boundary filtering is enabled for the at least one block based on a syntax element in the received coded video stream. The method further includes, based on a determination that the boundary filtering is enabled: filtering one or more boundary samples corresponding to the at least one block to generate one or more filtered samples, and decoding the at least one block based on the generated one or more filtered samples. The method further includes based on a determination that the boundary filtering is not enabled, decoding the at least one block without filtering the one or more boundary samples.

## Claims

### Claim 1

A method performed by at least one processor in a video decoder, the method comprising:
receiving a coded video bitstream that includes a current picture with at least one block located at a boundary of the current picture and coded in accordance with one of (i) an intra block copy (IBC) mode, (ii) an intra template matching (intraTMP) mode, and (iii) an IBC merge mode;
determining whether boundary filtering is enabled for the at least one block based on a syntax element in the received coded video stream;
based on a determination that the boundary filtering is enabled:
filtering one or more boundary samples corresponding to the at least one block to generate one or more filtered samples, and
decoding the at least one block based on the generated one or more filtered samples; and
based on a determination that the boundary filtering is not enabled, decoding the at least one block without filtering the one or more boundary samples.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the syntax element specifies that the boundary filtering is enabled based on a determination that the at least one block is encoded in one of the IBC mode and the intraTMP mode.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the boundary filtering includes a position-dependent predictor combination (PDPC) filter.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the boundary filtering includes a weighted average of neighboring reconstructed samples and adjacent boundary prediction samples.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the neighboring reconstructed samples include one or more columns located left of the at least one block.

### Claim 6 (depends on 5)

The method of claim 5, wherein a number of columns located left of the at least one block that are used in the boundary filtering is dependent on a block size of the at least one block.

### Claim 7 (depends on 4)

The method according to claim 4, wherein the neighboring reconstructed samples include one or more rows located top of the at least one block.

### Claim 8 (depends on 7)

The method according to claim 7, wherein a number of rows located top of the at least one block that are used in the boundary filtering is dependent on a block size of the at least one block.

### Claim 9 (depends on 1)

The method according to claim 1, wherein the at least one block is encoded in the IBC mode, and wherein the syntax element specifies that the boundary filtering is disabled based on a determination that a template matching cost calculated based on a template area pointed to by a block vector of the at least one block is below or equal to a threshold value.

### Claim 10 (depends on 9)

The method according to claim 9, wherein the boundary filtering includes a position-dependent predictor combination (PDPC) filter, and wherein a S parameter of the PDPC filter is dependent on the template matching cost.

### Claim 11 (depends on 1)

The method of claim 1, wherein the at least one block is encoded in the intraTMP mode, wherein the syntax element specifies that the boundary filtering is disabled based on a determination that a template matching cost of a template used in the intraTMP mode is below or equal to a threshold value.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the boundary filtering includes a position-dependent predictor combination (PDPC) filter, and wherein a S parameter of the PDPC filter is dependent on the template matching cost.

### Claim 13 (depends on 1)

The method according to claim 1, wherein the syntax element specifies that the boundary filtering is disabled based on a determination the at least one block is coded in the IBC merge mode.

### Claim 14 (depends on 1)

The method according to claim 1, wherein the syntax element specifies that the boundary filtering is enabled based on a determination the at least one block is coded in the IBC merge mode, wherein the boundary filtering uses reconstructed neighboring samples located left of the at least one block, and wherein a block vector of the at least one block is derived from spatial candidates located top of the at least one block or top-right of the at least one block.

### Claim 15 (depends on 1)

The method according to claim 1, wherein the syntax element specifies the boundary filtering is enabled based on a determination the at least one block is coded in the IBC merge mode, wherein the boundary filtering uses reconstructed neighboring samples located top of the at least one block, and wherein a block vector of the at least one block is derived from spatial candidates located left of the at least one block or bottom-left of the at least one block.

### Claim 16

A video decoder comprising:
at least one memory configured to store computer program code; and
at least one processor configured to access the computer program code and operate as instructed by the computer program code, the computer program code including:
receiving code configured to cause the at least one processor to receive a coded video bitstream that includes a current picture with at least one block located at a boundary of the current picture and coded in accordance with one of (i) an intra block copy (IBC) mode, (ii) an intra template matching (intraTMP) mode, and (iii) an IBC merge mode,
determining code configured to cause the at least one processor to determine whether boundary filtering is enabled for the at least one block based on a syntax element in the received coded video stream,
filtering code, and
determining code,
wherein based on a determination that the boundary filtering is enabled:
the filtering code is configured to cause the at least one processor to filter one or more boundary samples corresponding to the at least one block to generate one or more filtered samples, and
the decoding code is configured to cause the at least one processor to decode the at least one block based on the generated one or more filtered samples, and
wherein based on a determination that the boundary filtering is not enabled, the decoding code is configured to cause the at least one processor to decode the at least one block without filtering the one or more boundary samples.

### Claim 17 (depends on 16)

The video apparatus according to claim 16, wherein the syntax element specifies that the boundary filtering is enabled based on a determination that the at least one block is encoded in one of the IBC mode and the intraTMP mode.

### Claim 18 (depends on 16)

The video apparatus according to claim 16, wherein the boundary filtering includes a position-dependent predictor combination (PDPC) filter.

### Claim 19 (depends on 16)

The video apparatus according to claim 16, wherein the boundary filtering includes a weighted average of neighboring reconstructed samples and adjacent boundary prediction samples.

### Claim 20

A non-transitory computer readable medium having instructions stored therein, which when executed by a processor in a video decoder cause the processor to execute a method comprising:
receiving a coded video bitstream that includes a current picture with at least one block located at a boundary of the current picture and coded in accordance with one of (i) an intra block copy (IBC) mode, (ii) an intra template matching (intraTMP) mode, and (iii) an IBC merge mode;
determining whether boundary filtering is enabled for the at least one block based on a syntax element in the received coded video stream;
based on a determination that the boundary filtering is enabled:
filtering one or more boundary samples corresponding to the at least one block to generate one or more filtered samples, and
decoding the at least one block based on the generated one or more filtered samples; and
based on a determination that the boundary filtering is not enabled, decoding the at least one block without filtering the one or more boundary samples.
