# US 12,192,469 B2 · Derived intra prediction modes and most probable modes in video coding > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,192,469 B2 - Document ID: US12192469B2 - Status: Granted - Kind: B2 - Application number: 17/804,972 - Filed: 2022-06-01 - Published: 2022-12-08 - Granted: 2025-01-07 - Earliest claimed: 2021-06-03 - Assignees: QUALCOMM Incorporated - Applicants: QUALCOMM Incorporated - Inventors: Keming Cao; Nan Hu; Vadim Seregin; Marta Karczewicz - Web page: https://patentgrep.com/patent/US12192469B2 ## CPC - H04N 19/11: among a plurality of spatial predictive coding modes - H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/146: Data rate or code amount at the encoder output - H04N 19/147: according to rate distortion criteria (rate-distortion as a criterion for motion estimation H04N19/567) - H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction - H04N 19/176: the region being a block, e.g. a macroblock - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method of encoding or decoding video data comprises: for each respective intra prediction mode of a plurality of intra prediction modes in a most-probable mode (MPM) list: generating, based on reference samples for a template region and using the respective intra prediction mode, prediction samples for the template region; and determining a cost for the respective intra prediction mode; determining a first intra prediction mode and a second intra prediction mode in the MPM list having lowest costs; determining a preliminary prediction block for the first intra prediction mode and a preliminary prediction block for the second intra prediction mode; generating a prediction block based on a fusion of the preliminary prediction blocks weighted according to a weight for the first intra prediction mode and a weight for the second intra prediction mode. ## Claims ### Claim 1 A method of encoding or decoding video data, the method comprising: for each respective intra prediction mode of a plurality of intra prediction modes in a most-probable mode (MPM) list: generating, based on reference samples for a template region and using the respective intra prediction mode, prediction samples for the template region, wherein the template region is above or left of a block of the video data; and determining a respective cost for the respective intra prediction mode based on differences between (1) the prediction samples for the template region and (2) reconstructed samples for the template region; determining a first intra prediction mode in the MPM list and a second intra prediction mode in the MPM list, wherein the first intra prediction mode and the second intra prediction mode are intra prediction modes in the MPM list having lowest determined respective costs, the lowest determined respective costs including a first determined cost for the first intra prediction mode and a second determined cost for the second intra prediction mode; determining a weight for the first intra prediction mode based on the first determined cost for the first intra prediction mode and a weight for the second intra prediction mode based on the second determined cost for the second intra prediction mode; determining a preliminary prediction block for the first intra prediction mode and a preliminary prediction block for the second intra prediction mode; generating a prediction block based on a fusion of the preliminary prediction block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode weighted according to the weight for the first intra prediction mode and the weight for the second intra prediction mode; and one of reconstructing the block based on the prediction block, or encoding the block based on the prediction block. ### Claim 2 (depends on 1) The method of claim 1, wherein generating the prediction block based on the fusion of the preliminary block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode comprises generating the prediction block based on the fusion of the preliminary block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode based on the first intra prediction mode and the second intra prediction mode being different. ### Claim 3 (depends on 1) The method of claim 1, wherein: the method further comprises determining a cost of the fusion of the preliminary block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode, and generating the prediction block based on the fusion of the preliminary block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode comprises generating the prediction block based on the fusion of the preliminary block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode based on the cost of the fusion being less than a cost of any of the intra prediction modes. ### Claim 4 (depends on 1) The method of claim 1, wherein generating the prediction block based on the fusion of the preliminary prediction block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode comprises generating the prediction block based on prediction parameters derived from subblock sizes. ### Claim 5 (depends on 1) The method of claim 1, wherein generating the prediction block based on the fusion of the preliminary block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode comprises generating the prediction block based on a fusion of the preliminary prediction block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode weighted according to the weight for the first intra prediction mode and the weight for the second intra prediction mode based on the cost of the second intra prediction mode minus the cost of the first intra prediction mode being less than the cost of the first intra prediction mode. ### Claim 6 A device for encoding or decoding video data, the device comprising: a memory to store the video data; and one or more processors implemented in circuitry, the one or more processors configured to: for each respective intra prediction mode of a plurality of intra prediction modes in a most-probable mode (MPM) list: generate, based on reference samples for a template region and using the respective intra prediction mode, prediction samples for the template region, wherein the template region is above or left of a block of the video data; and determine a respective cost for the respective intra prediction mode based on differences between (1) the prediction samples for the template region and (2) reconstructed samples for the template region; determine a first intra prediction mode in the MPM list and a second intra prediction mode in the MPM list, wherein the first intra prediction mode and the second intra prediction mode are intra prediction modes in the MPM list having lowest determined respective costs, the lowest determined respective costs including a first determined cost for the first intra prediction mode and a second determined cost for the second intra prediction mode; determine a weight for the first intra prediction mode based on the first determined cost for the first intra prediction mode and a weight for the second intra prediction mode based on the second determined cost for the second intra prediction mode; determine a preliminary prediction block for the first intra prediction mode and a preliminary prediction block for the second intra prediction mode; generate a prediction block based on a fusion of the preliminary prediction block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode weighted according to the weight for the first intra prediction mode and the weight for the second intra prediction mode; and reconstruct the block based on the prediction block, or encode the block based on the prediction block. ### Claim 7 (depends on 6) The device of claim 6, wherein the one or more processors are configured to generate the prediction block based on the fusion of the preliminary block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode based on the first intra prediction mode and the second intra prediction mode being different. ### Claim 8 (depends on 6) The device of claim 6, wherein: the one or more processors are further configured to determine a cost of the fusion of the preliminary block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode, and the one or more processors are configured to generate the prediction block based on the fusion of the preliminary block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode based on the cost of the fusion being less than a cost of any of the intra prediction modes. ### Claim 9 (depends on 6) The device of claim 6, wherein the one or more processors are configured to generate the prediction block based on prediction parameters derived from subblock sizes. ### Claim 10 (depends on 6) The device of claim 6, wherein the one or more processors are configured to generate the prediction block based on a fusion of the preliminary prediction block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode weighted according to the weight for the first intra prediction mode and the weight for the second intra prediction mode based on the cost of the second intra prediction mode minus the cost of the first intra prediction mode being less than the cost of the first intra prediction mode. ### Claim 11 (depends on 6) The device of claim 6, further comprising a display configured to display decoded video data. ### Claim 12 (depends on 6) The device of claim 6, wherein the device comprises one or more of a camera, a computer, a mobile device, a broadcast receiver device, or a set-top box. ### Claim 13 A device for encoding or decoding video data, the device comprising: for each respective intra prediction mode of a plurality of intra prediction modes in a most-probable mode (MPM) list: means for generating, based on reference samples for a template region and using the respective intra prediction mode, prediction samples for the template region, wherein the template region is above or left of a block of the video data; and means for determining a respective cost for the respective intra prediction mode based on differences between (1) the prediction samples for the template region and (2) reconstructed samples for the template region; means for determining a first intra prediction mode in the MPM list and a second intra prediction mode in the MPM list, wherein the first intra prediction mode and the second intra prediction mode are intra prediction modes in the MPM list having lowest determined respective costs, the lowest determined respective costs including a first determined cost for the first intra prediction mode and a second determined cost for the second intra prediction mode; means for determining a weight for the first intra prediction mode based on the first determined cost for the first intra prediction mode and a weight for the second intra prediction mode based on the second determined cost for the second intra prediction mode; means for determining a preliminary prediction block for the first intra prediction mode and a preliminary prediction block for the second intra prediction mode; means for generating a prediction block based on a fusion of the preliminary prediction block for the first intra prediction mode and the preliminary prediction block for the second intra prediction mode weighted according to the weight for the first intra prediction mode and the weight for the second intra prediction mode; and means for reconstructing the block based on the prediction block or means for encoding the block based on the prediction block. ### Claim 14 (depends on 13) The device of claim 13, wherein the means for generating the prediction block based on the fusion of the preliminary blocks comprises means for generating the prediction block based on the fusion of the preliminary blocks based on the first intra prediction mode and the second intra prediction mode being different. ### Claim 15 (depends on 13) The device of claim 13, wherein: the device further comprises means for determining a cost of the fusion of the preliminary blocks, and the means for generating the prediction block based on the fusion of the preliminary blocks comprises means for generating the prediction block based on the fusion of the preliminary blocks based on the cost of the fusion being less than a cost of any of the intra prediction modes. ### Claim 16 (depends on 13) The device of claim 13, wherein the means for generating the prediction block based on the fusion of the preliminary prediction blocks comprises means for generating the prediction block based on prediction parameters derived from subblock sizes.