# US 12,003,711 B2 · Deblocking filter for video coding > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,003,711 B2 - Document ID: US12003711B2 - Status: Granted - Kind: B2 - Application number: 17/523,131 - Filed: 2021-11-10 - Published: 2022-03-03 - Granted: 2024-06-04 - Earliest claimed: 2019-05-11 - Assignees: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc. - Applicants: Beijing Bytedance Network Technology Co., Ltd.; Bytedance Inc. - Inventors: Li Zhang; Weijia Zhu; Kai Zhang; Hongbin Liu; Jizheng Xu - Web page: https://patentgrep.com/patent/US12003711B2 ## CPC - H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) - H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking - H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence) - H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/82: involving filtering within a prediction loop - H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract In an exemplary aspect, a method for visual media processing includes identifying a boundary at a vertical edge and/or a horizontal edge of two video blocks; calculating a boundary strength of a filter based on at least one of the two video blocks crossing a vertical edge or a horizontal edge is coded using a combined intra-inter prediction (CIIP) mode; deciding whether to turn on or off the filter; selecting a strength of the filter in case the filter is turned on; and performing, based on the selecting, a deblocking filter (DB) process to the video blocks. ## Claims ### Claim 1 A method of processing video data, comprising: identifying, for applying a deblocking filtering process to a first video block and a second video block of a video during a conversion between the first and second video blocks and a bitstream of the video, at least one boundary at a vertical edge and/or a horizontal edge of the first and second video blocks, wherein the at least one boundary includes a prediction subblock boundary; determining a boundary strength of the at least one boundary; deciding whether to turn on or off a filter for the at least one boundary based on the boundary strength; selecting a strength of the filter in case the filter is turned on; and performing the conversion based on the selecting, wherein the boundary strength is determined based on whether an absolute difference between a horizontal or vertical component of block vectors used in a prediction of the first and second video blocks is greater than or equal to a threshold in case that both the first and second video blocks are coded using an intra block copy prediction mode, wherein the threshold is a non-integer, and wherein the prediction subblock boundary includes a prediction unit boundary introduced by a subblock-based temporal motion vector predictor mode or an affine motion compensation mode, and wherein the deblocking filtering process is applied on an 8x8 grid for the prediction subblock boundary. ### Claim 2 (depends on 1) The method of claim 1, wherein the conversion includes encoding the first and second video blocks into the bitstream. ### Claim 3 (depends on 1) The method of claim 1, wherein the conversion includes decoding the first and second video blocks from the bitstream. ### Claim 4 (depends on 1) The method of claim 1, wherein the at least one boundary further includes a transform boundary or a coding unit boundary, wherein the boundary strength is equal to 2 in case that at least one of the first video block and the second video block crossing the vertical edge or the horizontal edge is coded using a combined inter-intra prediction mode, wherein in the combined inter-intra prediction mode, a prediction signal of the at least one of the first and second video blocks is generated at least based on an intra prediction signal and an inter prediction signal. ### Claim 5 (depends on 4) The method of claim 4, wherein the boundary strength is determined based on whether different reference pictures or a different number of motion vectors are used in the prediction of the two video blocks. ### Claim 6 (depends on 4) The method of claim 4, wherein a stronger deblocking filter is used in the deblocking filtering process when samples at either one side of the at least one boundary belong to a large block, where a sample belonging to the large block is defined as when width is larger than or equal to 32 for the vertical edge, and when height is larger than or equal to 32 for the horizontal edge. ### Claim 7 (depends on 6) The method of claim 6, wherein the stronger deblocking filter is a bilinear filter. ### Claim 8 An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to: identify, for applying a deblocking filtering process to a first video block and a second video block of a video during a conversion between the first and second video blocks and a bitstream of the video, at least one boundary at a vertical edge and/or a horizontal edge of the first and second video blocks, wherein the at least one boundary includes a prediction subblock boundary; determine a boundary strength of the at least one boundary; decide whether to turn on or off a filter for the at least one boundary based on the boundary strength; select a strength of the filter in case the filter is turned on; and perform the conversion based on the selecting, wherein the boundary strength is determined based on whether an absolute difference between a horizontal or vertical component of block vectors used in a prediction of the first and second video blocks is greater than or equal to a threshold in case that both the first and second video blocks are coded using an intra block copy prediction mode, wherein the threshold is a non-integer, and wherein the prediction subblock boundary includes a prediction unit boundary introduced by a subblock-based temporal motion vector predictor mode or an affine motion compensation mode, and wherein the deblocking filtering process is applied on an 8x8 grid for the prediction subblock boundary. ### Claim 9 (depends on 8) The apparatus of claim 8, wherein the at least one boundary further includes a transform boundary or a coding unit boundary, wherein the boundary strength is equal to 2 in case that at least one of the first video block and the second video block crossing the vertical edge or the horizontal edge is coded using a combined inter-intra prediction mode, wherein in the combined inter-intra prediction mode, a prediction signal of the at least one of the first and second video blocks is generated at least based on an intra prediction signal and an inter prediction signal. ### Claim 10 (depends on 9) The apparatus of claim 9, wherein the boundary strength is determined based on whether different reference pictures or a different number of motion vectors are used in the prediction of the first and second video blocks. ### Claim 11 (depends on 9) The apparatus of claim 9, wherein a stronger deblocking filter is used in the deblocking filtering process when samples at either one side of the at least one boundary belong to a large block, where a sample belonging to the large block is defined as when width is larger than or equal to 32 for the vertical edge, and when height is larger than or equal to 32 for the horizontal edge. ### Claim 12 (depends on 11) The apparatus of claim 11, wherein the stronger deblocking filter is a bilinear filter. ### Claim 13 A non-transitory computer-readable storage medium storing instructions that cause a processor to: identify, for applying a deblocking filtering process to a first video block and a second video block of a video during a conversion between the first and second video blocks and a bitstream of the video, at least one boundary at a vertical edge and/or a horizontal edge of the first and second video blocks, wherein the at least one boundary includes a prediction subblock boundary; determine a boundary strength of the at least one boundary; decide whether to turn on or off a filter for the at least one boundary based on the boundary strength; select a strength of the filter in case the filter is turned on; and perform the conversion based on the selecting, wherein the boundary strength is determined based on whether an absolute difference between a horizontal or vertical component of block vectors used in a prediction of the first and second video blocks is greater than or equal to a threshold in case that both the first and second video blocks are coded using an intra block copy prediction mode, wherein the threshold is a non-integer, and wherein the prediction subblock boundary includes a prediction unit boundary introduced by a subblock-based temporal motion vector predictor mode or an affine motion compensation mode, and wherein the deblocking filtering process is applied on an 8x8 grid for the prediction subblock boundary. ### Claim 14 (depends on 13) The non-transitory computer-readable storage medium of claim 13, wherein the at least one boundary further includes a transform boundary or a coding unit boundary, wherein the boundary strength is equal to 2 in case that at least one of the first video block and the second video block crossing the vertical edge or the horizontal edge is coded using a combined inter-intra prediction mode, wherein in the combined inter-intra prediction mode, a prediction signal of the at least one of the first and second video blocks is generated at least based on an intra prediction signal and an inter prediction signal. ### Claim 15 (depends on 14) The non-transitory computer-readable storage medium of claim 14, wherein the boundary strength is determined based on whether different reference pictures or a different number of motion vectors are used in the prediction of the first and second video blocks. ### Claim 16 (depends on 14) The non-transitory computer-readable storage medium of claim 14, wherein a stronger deblocking filter is used in the deblocking filtering process when samples at either one side of the at least one boundary belong to a large block, where a sample belonging to the large block is defined as when width is larger than or equal to 32 for the vertical edge, and when height is larger than or equal to 32 for the horizontal edge. ### Claim 17 (depends on 16) The non-transitory computer-readable storage medium of claim 16, wherein the stronger deblocking filter is a bilinear filter. ### Claim 18 (depends on 15) The non-transitory computer-readable recording medium of claim 15, wherein the boundary strength is determined based on whether different reference pictures or a different number of motion vectors are used in a prediction of the two video blocks. ### Claim 19 (depends on 18) The method of claim 18, wherein the at least one boundary further includes a transform boundary or a coding unit boundary, wherein the boundary strength is equal to 2 in case that at least one of the first video block and the second video block crossing the vertical edge or the horizontal edge is coded using a combined inter-intra prediction mode, wherein in the combined inter-intra prediction mode, a prediction signal of the at least one of the first and second video blocks is generated at least based on an intra prediction signal and an inter prediction signal. ### Claim 20 (depends on 19) The method of claim 19, wherein the boundary strength is determined based on whether different reference pictures or a different number of motion vectors are used in the prediction of the first and second video blocks.