# US 12,192,442 B2 · Device and method for intra predictions in video coding > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,192,442 B2 - Document ID: US12192442B2 - Status: Granted - Kind: B2 - Application number: 17/943,804 - Filed: 2022-09-13 - Published: 2023-03-23 - Granted: 2025-01-07 - Earliest claimed: 2021-09-13 - Assignees: Sharp Kabushiki Kaisha - Applicants: Sharp Kabushiki Kaisha - Inventors: Chih-Yu Teng; Yu-Chiao Yang - Web page: https://patentgrep.com/patent/US12192442B2 ## CPC - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/11: among a plurality of spatial predictive coding modes - H04N 19/136: Incoming video signal characteristics or properties - H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) - H04N 19/463: by compressing encoding parameters before transmission - H04N 19/593: involving spatial prediction techniques - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method of decoding video data is provided. The method includes: receiving the video data; determining, from an image frame of the video data, a block unit; determining a first intra prediction of the block unit based on a decoder-side intra mode derivation (DIMD) mode; determining a second intra prediction of the block unit based on an intra prediction mode other than the DIMD mode; generating a third intra prediction based on the first intra prediction and the second intra prediction; and reconstructing the block unit based on the third intra prediction. In addition, an electronic device using the method is also provided. ## Claims ### Claim 1 A method of decoding video data performed by an electronic device, the method comprising: receiving the video data; determining, from an image frame of the video data, a block unit; determining a first intra prediction of the block unit based on a decoder-side intra mode derivation (DIMD) mode, wherein determining the first intra prediction of the block unit based on the DIMD mode comprises: generating a histogram of gradient (HoG) list based on a first template region of the block unit, the HoG list comprising a plurality of angular modes associated with the block unit, wherein: a plurality of template angles and a plurality of template amplitudes corresponding to the plurality of template angles are calculated by applying a filter on each of a plurality of positions in the first template region, and each of the plurality of template angles corresponds to one of the plurality of angular modes; determining a second intra prediction of the block unit based on an intra prediction mode other than the DIMD mode; generating a third intra prediction based on the first intra prediction and the second intra prediction; and reconstructing the block unit based on the third intra prediction. ### Claim 2 (depends on 1) The method of claim 1, wherein the intra prediction mode other than the DIMD mode comprises at least one of a planar mode, a linear model mode, a direct current (DC) mode, or one of the plurality of angular modes different from the DIMD mode. ### Claim 3 (depends on 1) The method of claim 1, wherein the second intra prediction is determined based on a template-based intra mode derivation (TIMD) mode, and determining the second intra prediction of the block unit based on the TIMD mode comprises: determining a second template region associated with the block unit, the second template region comprising a first reconstructed block left-neighboring the block unit and a second reconstructed block upper-neighboring the block unit; calculating a plurality of template costs for a plurality of candidate modes of a candidate list respectively based on the second template region; selecting a first candidate mode of the plurality of candidate modes corresponding to a first minimum template cost of the plurality of template costs and a second candidate mode of the plurality of candidate modes corresponding to a second minimum template cost of the plurality of template costs, wherein the first minimum template cost comprises a least template cost in the plurality of template costs, and the second minimum template cost comprises a template cost that is greater than the first minimum template cost, but less than all other template costs in the plurality of template costs; and determining the second intra prediction based on the first candidate mode and the second candidate mode. ### Claim 4 (depends on 3) The method of claim 3, wherein calculating the plurality of template costs for the plurality of candidate modes of the candidate list respectively based on the second template region comprises: generating a plurality of predictions of the second template region based on a plurality of reference samples of the second template region, the plurality of predictions corresponding to the plurality of candidate modes of the candidate list; and calculating a plurality of template costs for the plurality of predictions based on a template reconstruction of the second template region, the plurality of template costs for the plurality of predictions corresponding to the plurality of template costs for the plurality of candidate modes of the candidate list. ### Claim 5 (depends on 3) The method of claim 3, wherein determining the second intra prediction based on the first candidate mode and the second candidate mode comprises: determining whether the second minimum template cost is less than twice the first minimum template cost; in a case that the second minimum template cost is less than twice the first minimum template cost, determining the second intra prediction based on the first candidate mode; and in a case that the second minimum template cost is not less than twice the first minimum template cost, determining the second intra prediction based on the first candidate mode, the second candidate mode, the first minimum template cost, and the second minimum template cost. ### Claim 6 (depends on 1) The method of claim 1, wherein determining the first intra prediction of the block unit based on the DIMD mode comprises: selecting at least one of the plurality of angular modes for determining the first intra prediction, wherein the first template region of the block unit comprises a first reconstructed region adjacent to a left side of the block unit, a second reconstructed region adjacent to an upper side of the block unit, and a third reconstructed region joining the first reconstructed region and the second reconstructed region. ### Claim 7 (depends on 6) The method of claim 6, wherein the at least one of the plurality of angular modes corresponds to at least one largest template amplitude within the plurality of template amplitudes. ### Claim 8 (depends on 1) The method of claim 1, wherein generating the third intra prediction based on the first intra prediction and the second intra prediction comprises: determining a first weight corresponding to the first intra prediction and a second weight corresponding to the second intra prediction; and generating the third intra prediction by calculating a weighted average of the first intra prediction and the second intra prediction based on the first weight and the second weight. ### Claim 9 (depends on 1) The method of claim 1, further comprising: decoding a specific flag in the video data, wherein the specific flag indicates whether to use the third intra prediction for reconstructing the block unit. ### Claim 10 An electronic device for decoding video data, the electronic device comprising: one or more processors; and one or more non-transitory computer-readable media coupled to the one or more processors and storing one or more computer-executable instructions that, when executed by at least one of the one or more processors, cause the electronic device to: receive the video data; determine, from an image frame of the video data, a block unit; determine a first intra prediction of the block unit based on a decoder-side intra mode derivation (DIMD) mode, wherein determining the first intra prediction of the block unit based on the DIMD mode comprises: generating a histogram of gradient (HoG) list based on a first template region of the block unit, the HoG list comprising a plurality of angular modes associated with the block unit, wherein: a plurality of template angles and a plurality of template amplitudes corresponding to the plurality of template angles are calculated by applying a filter on each of a plurality of positions in the first template region, and each of the plurality of template angles corresponds to one of the plurality of angular modes; determine a second intra prediction of the block unit based on an intra prediction mode other than the DIMD mode; generate a third intra prediction based on the first intra prediction and the second intra prediction; and reconstruct the block unit based on the third intra prediction. ### Claim 11 (depends on 10) The electronic device of claim 10, wherein the intra prediction mode other than the DIMD mode comprises at least one of a planar mode, a linear model mode, a direct current (DC) mode, or one of the plurality of angular modes different from the DIMD mode. ### Claim 12 (depends on 10) The electronic device of claim 10, wherein the second intra prediction is determined based on a template-based intra mode derivation (TIMD) mode, and determining the second intra prediction of the block unit based on the TIMD mode comprises: determining a second template region associated with the block unit, the second template region comprising a first reconstructed block left-neighboring the block unit and a second reconstructed block upper-neighboring the block unit; calculating a plurality of template costs for a plurality of candidate modes of a candidate list respectively based on the second template region; selecting a first candidate mode of the plurality of candidate modes corresponding to a first minimum template cost of the plurality of template costs and a second candidate mode of the plurality of candidate modes corresponding to a second minimum template cost of the plurality of template costs, wherein the first minimum template cost comprises a least template cost in the plurality of template costs, and the second minimum template cost comprises a template cost that is greater than the first minimum template cost, but less than all other template costs in the plurality of template costs; and determining the second intra prediction based on the first candidate mode and the second candidate mode. ### Claim 13 (depends on 12) The electronic device of claim 12, wherein calculating the plurality of template costs for the plurality of candidate modes of the candidate list respectively based on the second template region comprises: generating a plurality of predictions of the second template region based on a plurality of reference samples of the second template region, the plurality of predictions corresponding to the plurality of candidate modes of the candidate list; and calculating a plurality of template costs for the plurality of predictions based on a template reconstruction of the second template region, the plurality of template costs for the plurality of predictions corresponding to the plurality of template costs for the plurality of candidate modes of the candidate list. ### Claim 14 (depends on 12) The electronic device of claim 12, wherein determining the second intra prediction based on the first candidate mode and the second candidate mode comprises: determining whether the second minimum template cost is less than twice the first minimum template cost; in a case that the second minimum template cost is less than twice the first minimum template cost, determining the second intra prediction based on the first candidate mode; and in a case that the second minimum template cost is not less than twice the first minimum template cost, determining the second intra prediction based on the first candidate mode, the second candidate mode, the first minimum template cost, and the second minimum template cost. ### Claim 15 (depends on 10) The electronic device of claim 10, wherein determining the first intra prediction of the block unit based on the DIMD mode comprises: selecting at least one of the plurality of angular modes for determining the first intra prediction, wherein the first template region of the block unit comprises a first reconstructed region adjacent to a left side of the block unit, a second reconstructed region adjacent to an upper side of the block unit, and a third reconstructed region joining the first reconstructed region and the second reconstructed region. ### Claim 16 (depends on 15) The electronic device of claim 15, wherein the at least one of the plurality of angular modes corresponds to at least one largest template amplitude within the plurality of template amplitudes. ### Claim 17 (depends on 10) The electronic device of claim 10, wherein generating the third intra prediction based on the first intra prediction and the second intra prediction comprises: determining a first weight corresponding to the first intra prediction and a second weight corresponding to the second intra prediction; and generating the third intra prediction by calculating a weighted average of the first intra prediction and the second intra prediction based on the first weight and the second weight. ### Claim 18 (depends on 10) The electronic device of claim 10, wherein the one or more computer-executable instructions, when executed by the at least one of the one or more processors, further cause the electronic device to: decode a specific flag in the video data, wherein the specific flag indicates whether to use the third intra prediction for reconstructing the block unit.