# US 11,909,994 B2 · Method and apparatus for intra-prediction coding of video data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,909,994 B2
- Document ID: US11909994B2
- Status: Granted
- Kind: B2
- Application number: 18/093,533
- Filed: 2023-01-05
- Published: 2023-05-18
- Granted: 2024-02-20
- Earliest claimed: 2019-06-24
- Assignees: Hyundai Motor Company; Kia Corporation; Ewha University-Industry Collaboration Foundation
- Applicants: Hyundai Motor Company; Kia Corporation; Ewha University-Industry Collaboration Foundation
- Inventors: Je Won Kang; Sang Hyo Park; Seung Wook Park; Wha Pyeong Lim
- Web page: https://patentgrep.com/patent/US11909994B2

## CPC

- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method and apparatus for intra-prediction coding of video data are provided. The apparatus includes a decoder that is configured to decode, from a bitstream, a syntax element indicating an intra-prediction type of a current block of the video data, and an intra-predictor that is configured to generate a prediction block for the current block by selectively performing matrix based intra-prediction or regular intra-prediction based on the intra-prediction type of the current block indicated by the syntax element.

## Claims

### Claim 1

A method of encoding video data, comprising:
encoding, into a bitstream, a syntax element indicating an intra-prediction type of a current luma block of the video data, the intra-prediction type being indicated from among matrix based intra-prediction (MIP) and regular intra-prediction; and
generating a prediction block for the current luma block by selectively performing the MIP or the regular intra-prediction based on the intra-prediction type of the current luma block,
wherein the generating of the prediction block for the current luma block by performing the regular intra-prediction includes:
determining a regular intra-prediction mode for the current luma block,
deriving Most Probable Mode (MPM) candidates based on a regular intra-prediction mode of each of neighboring blocks adjacent to the current luma block to configure an MPM list for the current luma block, wherein the regular intra-prediction mode of the neighboring block is set as a PLANAR mode when an intra-prediction type of the neighboring block is the MIP; and
encoding, into the bitstream, at least one syntax element indicating the regular intra-prediction mode for the current luma block based on the MPM list, and
wherein, when the MIP is performed on the current luma block, and the intra-prediction mode of the current luma block is used as an intra-prediction mode of a chroma block corresponding to the current luma block, the regular intra-prediction mode for the current luma block is set as the PLANAR mode, and
wherein the generating of the prediction block for the current luma block by performing the MIP includes:
encoding, into the bitstream, a syntax element indicating an MIP mode for the current luma block;
deriving a boundary vector using neighboring samples adjacent to the current luma block based on a width and a height of the current luma block;
generating predicted samples for the current luma block based on matrix-vector multiplication between the boundary vector and a matrix predefined for the MIP mode; and
deriving the prediction block for the current luma block based on the predicted samples, and
wherein the deriving of the boundary vector using the neighboring samples adjacent to the current luma block includes:
encoding, into the bitstream, a syntax element indicating a concatenation order of first entries of the boundary vector derived from the left neighboring samples adjacent to the current luma block and second entries of the boundary vector derived from the above neighboring samples adjacent to the current luma block; and
concatenating the first entries and the second entries according to the concatenation order and thereby generating the boundary vector.

### Claim 2 (depends on 1)

The method of claim 1, wherein the syntax element indicating the MIP mode for the current luma block is a truncated binary code which specifies one of a plurality of MIP modes allowed for the width and the height of the current luma block.

### Claim 3 (depends on 2)

The method of claim 2, wherein the deriving of the boundary vector using the neighboring samples adjacent to the current luma block includes:
deriving the boundary vector from one or two sets selected from between a set of left neighboring samples and a set of above neighboring samples adjacent to the current luma block, depending on the MIP mode for the current luma block.

### Claim 4 (depends on 2)

The method of claim 2, wherein entries of the boundary vector are derived based on down-sampled values from left neighboring samples adjacent to the current luma block or the left neighboring samples adjacent to the current luma block according to the width and the height of the current luma block.

### Claim 5 (depends on 2)

The method of claim 2, wherein the deriving of the prediction block for the current luma block based on the predicted samples includes:
allocating the predicted samples to positions in the prediction block; and
generating predicted sample values for positions to which the predicted samples are not allocated in the prediction block, based on using linear interpolation for the predicted samples, left neighboring samples adjacent to the current luma block, and above neighboring samples adjacent to the current luma block.

### Claim 6

A non-transitory computer readable medium storing a bitstream containing encoded data for blocks of video data, the bitstream being generated by processes of:
encoding, into a bitstream, a syntax element indicating an intra-prediction type of a current luma block of the video data, the intra-prediction type being indicated from among matrix based intra-prediction (MIP) and regular intra-prediction; and
generating a prediction block for the current luma block by selectively performing the MIP or the regular intra-prediction based on the intra-prediction type of the current luma block,
wherein the generating of the prediction block for the current luma block by performing the regular intra-prediction includes:
determining a regular intra-prediction mode for the current luma block,
deriving Most Probable Mode (MPM) candidates based on a regular intra-prediction mode of each of neighboring blocks adjacent to the current luma block to configure an MPM list for the current luma block, wherein the regular intra-prediction mode of the neighboring block is set as a PLANAR mode when an intra-prediction type of the neighboring block is the MIP; and
encoding, into the bitstream, at least one syntax element indicating the regular intra-prediction mode for the current luma block based on the MPM list, and
wherein, when the MIP is performed on the current luma block, and the intra-prediction mode of the current luma block is used as an intra-prediction mode of a chroma block corresponding to the current luma block, the regular intra-prediction mode for the current luma block is set as the PLANAR mode, and
wherein the generating of the prediction block for the current luma block by performing the MIP includes:
encoding, into the bitstream, a syntax element indicating an MIP mode for the current luma block;
deriving a boundary vector using neighboring samples adjacent to the current luma block based on a width and a height of the current luma block;
generating predicted samples for the current luma block based on matrix-vector multiplication between the boundary vector and a matrix predefined for the MIP mode; and
deriving the prediction block for the current luma block based on the predicted samples, and
wherein the deriving of the boundary vector using the neighboring samples adjacent to the current luma block includes:
encoding, into the bitstream, a syntax element indicating a concatenation order of first entries of the boundary vector derived from the left neighboring samples adjacent to the current luma block and second entries of the boundary vector derived from the above neighboring samples adjacent to the current luma block; and
concatenating the first entries and the second entries according to the concatenation order and thereby generating the boundary vector.
