# US 12,010,316 B2 · Modification on fusion of intra prediction > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,010,316 B2 - Document ID: US12010316B2 - Status: Granted - Kind: B2 - Application number: 17/943,275 - Filed: 2022-09-13 - Published: 2023-04-06 - Granted: 2024-06-11 - Earliest claimed: 2021-10-05 - Assignees: Tencent America LLC - Applicants: Tencent America LLC - Inventors: Ling Li; Xiang Li; Shan Liu - Web page: https://patentgrep.com/patent/US12010316B2 ## CPC - H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence) - H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/593: involving spatial prediction techniques - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract One or more intra mode predictors of a current block are determined, where the one or more intra mode predictors are derived based on the neighboring samples of the current block via either a decoder side intra mode derivation (DIMD) or a template-based intra mode derivation (TIMD). Whether a position dependent intra prediction combination (PDPC) is to be applied is determined based on the one or more intra mode predictors. In response to the determining that the PDPC is to be applied, a fusion process is performed on the one or more intra mode predictors to combine the one or more intra mode predictors into a single intra mode predictor. The PDPC is applied based on the single intra mode predictor to generate a modified predictor of the current block. The current block is reconstructed based on the modified predictor generated by the PDPC. ## Claims ### Claim 1 A method of video decoding performed in a video decoder, the method comprising: receiving coded information of a current block and neighboring samples of the current block from a coded video bitstream; determining a plurality of intra mode predictors of the current block, wherein the plurality of intra mode predictors is derived based on the neighboring samples of the current block via either a decoder side intra mode derivation (DIMD) or a template-based intra mode derivation (TIMD); determining whether a position dependent intra prediction combination (PDPC) is to be applied based on the plurality of intra mode predictors; in response to the PDPC being determined to be applied, performing a fusion process on the plurality of intra mode predictors to generate a single intra mode predictor that is a weighted combination of the plurality of intra mode predictors; applying the PDPC based on the single intra mode predictor to generate a modified predictor of the current block subsequent to the fusion process on the plurality of intra mode predictors, the modified predictor being generated based on (i) one or more neighboring samples of the neighboring samples and (ii) the single intra mode predictor; and reconstructing the current block based on the modified predictor generated by the PDPC. ### Claim 2 (depends on 1) The method of claim 1, wherein the determining the plurality of intra mode predictors further comprises: in response to the plurality of intra mode predictors being derived based on the DIMD, determining a first intra mode predictor of the plurality of intra mode predictors based on a first intra mode, the first intra mode being determined based on the neighboring samples and associated with a highest histogram of gradient (HoG) of the neighboring samples; determining a second intra mode predictor of the plurality of intra mode predictors based on a second intra mode, the second intra mode being determined based on the neighboring samples and associated with a second highest HoG of the neighboring samples; and determining a third intra mode predictor of the plurality of intra mode predictors based on a planar mode. ### Claim 3 (depends on 2) The method of claim 2, wherein the determining whether the PDPC is to be applied further comprises: determining whether the PDPC is applicable based on the first intra mode that is derived based on the DIMD. ### Claim 4 (depends on 2) The method of claim 2, wherein the determining whether the PDPC is to be applied further comprises: in response to the first intra mode and the second intra mode being angular modes, determining whether the PDPC is applicable based on an average angular value of the first intra mode and the second intra mode; and in response to one of the first intra mode and the second intra mode being an angular mode, determining whether the PDPC is applicable based on the one of the first intra mode and the second intra mode that is the angular mode. ### Claim 5 (depends on 1) The method of claim 1, wherein the determining whether the PDPC is to be applied further comprises: determining that the PDPC is applicable in response to at least plurality of intra mode predictors being determined based on a planar mode or a DC mode. ### Claim 6 (depends on 1) The method of claim 1, wherein the determining the plurality of intra mode predictors comprises: in response to the plurality of intra mode predictors being derived based on the TIMD, determining a first intra mode predictor of the plurality of intra mode predictors based on a first intra mode, the first intra mode being determined based on the neighboring samples and associated with a smallest cost value of the neighboring samples; and determining a second intra mode predictor of the plurality of intra mode predictors based on a second intra mode, the second intra mode being determined based on the neighboring samples and associated with a second smallest cost value of the neighboring samples. ### Claim 7 (depends on 6) The method of claim 6, wherein the determining whether the PDPC is to be applied further comprises: determining whether the PDPC is applicable based on the first intra mode that is derived based on the TIMD. ### Claim 8 (depends on 6) The method of claim 6, wherein the determining whether the PDPC is to be applied further comprises: in response to the first intra mode and the second intra mode being angular modes, determining whether the PDPC is applicable based on an average angular value of the first intra mode and the second intra mode; and in response to one of the first intra mode and the second intra mode being an angular mode, determining whether the PDPC is applicable based on the one of the first intra mode and the second intra mode that is the angular mode. ### Claim 9 (depends on 6) The method of claim 6, wherein the determining whether the PDPC is to be applied further comprises: determining that the PDPC is applicable in response to at least one of the first intra mode and the second intra mode being a planar mode or a DC mode. ### Claim 10 (depends on 1) The method of claim 1, wherein the determining whether the PDPC is to be applied further comprises: in response to one of the plurality of intra mode predictors being an angular mode and other ones of the plurality of intra mode predictors being non-angular modes, determining whether the PDPC is applicable based on the one of the plurality of intra mode predictors that is the angular mode. ### Claim 11 An apparatus, comprising: processing circuitry configured to: receive coded information of a current block and neighboring samples of the current block from a coded video bitstream; determine a plurality of intra mode predictors of the current block, wherein the plurality of intra mode predictors is derived based on the neighboring samples of the current block via either a decoder side intra mode derivation (DIMD) or a template-based intra mode derivation (TIMD); determine whether a position dependent intra prediction combination (PDPC) is to be applied based on the plurality of intra mode predictors; in response to the PDPC being determined to be applied, perform a fusion process on the plurality of intra mode predictors to generate a single intra mode predictor that is a weighted combination of the plurality of intra mode predictors; apply the PDPC based on the single intra mode predictor to generate a modified predictor of the current block subsequent to the fusion process on the plurality of intra mode predictors, the modified predictor being generated based on (i) one or more neighboring samples of the neighboring samples and (ii) the single intra mode predictor; and reconstruct the current block based on the modified predictor generated by the PDPC. ### Claim 12 (depends on 11) The apparatus of claim 11, wherein the processing circuitry is configured to: in response to the plurality of intra mode predictors being derived based on the DIMD, determine a first intra mode predictor of the plurality of intra mode predictors based on a first intra mode, the first intra mode being determined based on the neighboring samples and associated with a highest histogram of gradient (HoG) of the neighboring samples; determine a second intra mode predictor of the plurality of intra mode predictors based on a second intra mode, the second intra mode being determined based on the neighboring samples and associated with a second highest HoG of the neighboring samples; and determine a third intra mode predictor of the plurality of intra mode predictors based on a planar mode. ### Claim 13 (depends on 12) The apparatus of claim 12, wherein the processing circuitry is configured to: determine whether the PDPC is applicable based on the first intra mode that is derived based on the DIMD. ### Claim 14 (depends on 12) The apparatus of claim 12, wherein the processing circuitry is configured to: in response to the first intra mode and the second intra mode being angular modes, determine whether the PDPC is applicable based on an average angular value of the first intra mode and the second intra mode; and in response to one of the first intra mode and the second intra mode being an angular mode, determine whether the PDPC is applicable based on the one of the first intra mode and the second intra mode that is the angular mode. ### Claim 15 (depends on 11) The apparatus of claim 11, wherein the processing circuitry is configured to: determine that the PDPC is applicable in response to at least one of the plurality of intra mode predictors being determined based on a planar mode or a DC mode. ### Claim 16 (depends on 11) The apparatus of claim 11, wherein the processing circuitry is configured to: in response to the plurality of intra mode predictors being derived based on the TIMD, determine a first intra mode predictor of the plurality of intra mode predictors based on a first intra mode, the first intra mode being determined based on the neighboring samples and associated with a smallest cost value of the neighboring samples; and determine a second intra mode predictor of the plurality of intra mode predictors based on a second intra mode, the second intra mode being determined based on the neighboring samples and associated with a second smallest cost value of the neighboring samples. ### Claim 17 (depends on 16) The apparatus of claim 16, wherein the processing circuitry is configured to: determine whether the PDPC is applicable based on the first intra mode that is derived based on the TIMD. ### Claim 18 (depends on 16) The apparatus of claim 16, wherein the processing circuitry is configured to: in response to the first intra mode and the second intra mode being angular modes, determine whether the PDPC is applicable based on an average angular value of the first intra mode and the second intra mode; and in response to one of the first intra mode and the second intra mode being an angular mode, determine whether the PDPC is applicable based on the one of the first intra mode and the second intra mode that is the angular mode. ### Claim 19 (depends on 16) The apparatus of claim 16, wherein the processing circuitry is configured to: determine that the PDPC is applicable in response to at least one of the first intra mode and the second intra mode being a planar mode or a DC mode. ### Claim 20 (depends on 11) The apparatus of claim 11, wherein the processing circuitry is further configured to: in response to one of the plurality of intra mode predictors being an angular mode and other ones of the plurality of intra mode predictors being non-angular modes, determine whether the PDPC is to be applied based on the one of the plurality of intra mode predictors that is the angular mode.