# US 2022/0070455 A1 · Boundary strength determination for deblocking filters in video processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0070455 A1
- Document ID: US20220070455A1
- Status: Published application
- Kind: A1
- Application number: 17/524,477
- Filed: 2021-11-11
- Published: 2022-03-03
- Earliest claimed: 2019-05-11
- Assignees: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Applicants: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc.
- Inventors: Li ZHANG; Weijia ZHU; Kai ZHANG; Hongbin LIU; Jizheng XU
- Web page: https://patentgrep.com/patent/US20220070455A1

## CPC

- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/1883: {the unit relating to sub-band structure, e.g. hierarchical level, directional tree, e.g. low-high [LH], high-low [HL], high-high [HH]}
- H04N 19/635: characterised by filter definition or implementation details
- H04N 19/82: involving filtering within a prediction loop
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In an exemplary aspect, a method for visual media processing includes determining whether a pair of adjacent blocks of visual media data are both intra block copy (IBC) coded; and selectively applying, based on the determination, a deblocking filter (DB) process by identifying a boundary at a vertical edge and/or a horizontal edge of the pair of adjacent blocks, calculating a boundary strength of a filter, deciding whether to turn on or off the filter, and selecting a strength of the filter in case the filter is turned on, wherein the boundary strength of the filter is dependent on a motion vector difference between motion vectors associated with the pair of adjacent blocks.

## Claims

### Claim 1

A method for visual media processing, comprising:
selectively applying, based on a first determining, a deblocking filter (DB) process by identifying a first range of visual media data, calculating a boundary strength of a filter, deciding whether to turn on or off the filter, and selecting a strength of the filter in case the filter is turned on, wherein the boundary strength of the filter is independent of a motion vector difference between motion vectors associated with the pair of adjacent blocks,
wherein the first determining includes determining whether a pair of adjacent blocks of visual media data are both intra block copy (IBC) coded,
wherein the first range includes a boundary at a vertical edge and/or a horizontal edge of the pair of adjacent blocks of visual media data.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
upon determining that the pair of adjacent blocks are both IBC coded, selecting the boundary strength of the filter to M in case the pair of adjacent blocks are both intra block copy (IBC) coded regardless of the motion vector difference and regardless of whether a non-zero coefficient is associated with the pair of adjacent blocks, and wherein M is 0, 1, or 2.

### Claim 3 (depends on 1)

The method of claim 1, wherein the deblocking filter (DB) process is skipped at the boundaries of the pair of the IBC-coded blocks.

### Claim 4 (depends on 1)

The method of claim 1, wherein the deblocking filter (DB) process is skipped for samples of an IBC-coded block.

### Claim 5 (depends on 1)

The method of claim 1, wherein the method further comprising:
selectively applying, based on a second determining, a deblocking filter (DB) process by identifying a second range of visual media data, calculating the boundary strength of a filter, deciding whether to turn on or off the filter, and selecting a strength of the filter in case the filter is turned on,
wherein the second determining includes determining one or more sub-regions within a current video block of visual media data, wherein the current video block makes use of a decoder-side motion refinement coding tool,
wherein the second range includes boundaries of the one or more sub-regions within the current video block at vertical and/or horizontal edges.

### Claim 6 (depends on 5)

The method of claim 5, wherein the decoder-side motion refinement coding tool includes a decoder-side motion vector refinement (DMVR) technique, a prediction refinement with optical flow (PROF) technique, or a Bi-directional optical flow (BDOF) technique.

### Claim 7 (depends on 5)

The method of claim 5, wherein the one or more sub-regions within the current video block are defined based on sub-blocks on which the decoder-side motion refinement coding tool is applied, wherein the sub-blocks are included within the current video block.

### Claim 8 (depends on 7)

The method of claim 7, wherein the one or more sub-regions are sub-blocks of the current video block and have size M×N.

### Claim 9 (depends on 8)

The method of claim 8, wherein M=16 or 64 and N=16 or 64.

### Claim 10 (depends on 5)

The method of claim 5, wherein the DB process is selectively applied on a subset of the boundaries of the one or more sub-regions within the current video block.

### Claim 11 (depends on 5)

The method of claim 5, wherein the DB process is selectively applied on the boundaries of the one or more sub-regions within the current video block based upon a location of the one or more sub-regions relative to the current video block.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
optionally, turning the filter on for samples located at one or more bottom boundaries of a sub-region, wherein the one or more bottom boundaries of the sub-region is same as a bottom boundary of a coding tree unit (CTU) associated with the current video block,
optionally, turning the filter off for samples located at one or more bottom boundaries of a sub-region, wherein the one or more bottom boundaries of the sub-region is same as a bottom boundary of a coding tree unit (CTU) associated with the current video block,
optionally, turning the filter on for samples located at one or more right boundaries of a sub-region, wherein the one or more bottom boundaries of the sub-region is same as a bottom boundary of a coding tree unit (CTU) associated with the current video block,
optionally, turning the filter off for samples located at one or more right boundaries of a sub-region, wherein the one or more bottom boundaries of the sub-region is same as a bottom boundary of a coding tree unit (CTU) associated with the current video block,
optionally, turning the filter on for samples located at one or more right boundaries of a sub-region, wherein the one or more bottom boundaries of the sub-region is different from a bottom boundary of a coding tree unit (CTU) associated with the current video block,
optionally, turning the filter off for samples located at one or more right boundaries of a sub-region, wherein the one or more bottom boundaries of the sub-region is different from a bottom boundary of a coding tree unit (CTU) associated with the current video block.

### Claim 13 (depends on 5)

The method of claim 5, wherein the DB process further includes:
selectively using refined motion information or unrefined motion information for the one or more sub-regions within the current video block based upon a location of the one or more sub-regions relative to the current video block.

### Claim 14 (depends on 13)

The method of claim 13, wherein
using the refined information on samples located at one or more right boundaries of a sub-region, wherein the one or more bottom boundaries of the sub-region is different from a bottom boundary of a coding tree unit (CTU) associated with the current video block.

### Claim 15 (depends on 13)

The method of claim 13, wherein
using the unrefined information on samples located at one or more right boundaries of a sub-region, wherein the one or more bottom boundaries of the sub-region is different from a bottom boundary of a coding tree unit (CTU) associated with the current video block.

### Claim 16 (depends on 1)

The method of claim 1, wherein the conversion includes encoding the current video block into a bitstream.

### Claim 17 (depends on 1)

The method of claim 1, wherein the conversion includes decoding the current video block from a bitstream.

### Claim 18

An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:
selectively apply, based on a first determining, a deblocking filter (DB) process by identifying a first range of visual media data, calculating a boundary strength of a filter, deciding whether to turn on or off the filter, and selecting a strength of the filter in case the filter is turned on, wherein the boundary strength of the filter is independent of a motion vector difference between motion vectors associated with the pair of adjacent blocks,
wherein the first determining includes determining whether a pair of adjacent blocks of visual media data are both intra block copy (IBC) coded,
wherein the first range includes a boundary at a vertical edge and/or a horizontal edge of the pair of adjacent blocks of visual media data.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein the processor is further caused to:
selectively apply, based on a second determining, a deblocking filter (DB) process by identifying a second range of visual media data, calculating the boundary strength of a filter, deciding whether to turn on or off the filter, and selecting a strength of the filter in case the filter is turned on,
wherein the second determining includes determining one or more sub-regions within a current video block of visual media data, wherein the current video block makes use of a decoder-side motion refinement coding tool,
wherein the second range includes the boundaries of the one or more sub-regions within the current video block at vertical and/or horizontal edges.

### Claim 20

A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:
selectively applying, based on a first determining, a deblocking filter (DB) process by identifying a first range of visual media data, calculating a boundary strength of a filter, deciding whether to turn on or off the filter, and selecting a strength of the filter in case the filter is turned on, wherein the boundary strength of the filter is independent of a motion vector difference between motion vectors associated with the pair of adjacent blocks; and
generating the bitstream based on the applying;
wherein the first determining includes determining whether a pair of adjacent blocks of visual media data are both intra block copy (IBC) coded,
wherein the first range includes a boundary at a vertical edge and/or a horizontal edge of the pair of adjacent blocks of visual media data.
