Method and apparatus for video coding for improving predicted signals of intra prediction
AssigneesHyundai Motor Company, Kia Corporation, Ewha University-Industry Collaboration Foundation
InventorsJe Won Kang, Jung Kyung Lee, Na Young Kim, Seung Wook Park
Life of this patent
Estimating the term…
Abstract
A video coding method and an apparatus for refining predicted signals in intra prediction are disclosed. The video coding method and apparatus generate refined prediction signals approximating original video signals from predicted signals of intra prediction using a variable and fixed coefficient-based deep learning model to reduce the amount of data for residual signals, which are to be encoded.
Claims17
A video decoding apparatus comprising:
- an entropy decoder configured to decode an intra prediction mode and residual values of a current block from a bitstream, decode a refinement flag, or determine the refinement flag, wherein the refinement flag indicates whether to apply a deep learning-based refinement model at a time of intra prediction of the current block;
- an intra predictor configured to generate a prediction block of the current block using the intra prediction mode;
- a signal refinement unit configured to generate a refined prediction block from the prediction block using the refinement model when the refinement flag is 1;
- and
- an adder configured to generate a restored block of the current block by adding the residual values to the refined prediction block when the refinement flag is 1 or generate the restored block by adding the residual values to the prediction block when the refinement flag is 0.
A video encoding method performed by a video encoding apparatus for intra prediction of a current block, the method comprising:
- obtaining an intra prediction mode of the current block, obtaining a refinement flag, or determining the refinement flag, wherein the refinement flag indicates whether to apply a deep learning-based refinement model at a time of intra prediction of the current block;
- generating a prediction block of the current block using the intra prediction mode;
- and
- generating a residual block of the current block based on the refinement flag,
- wherein, when the refinement flag is 1, generating the residual block includes:
- generating a refined prediction block from the prediction block using the refinement model;
- and
- generating the residual block by subtracting the refined prediction block from the current block,
- wherein, when the refinement flag is 0, generating the residual block includes:
- generating the residual block by subtracting the prediction block from the current block.
A computer-readable recording medium storing a bitstream generated by a video encoding method for intra prediction of a current block, wherein the method comprising:
- obtaining an intra prediction mode of the current block, obtaining a refinement flag, or determining the refinement flag, wherein the refinement flag indicates whether to apply a deep learning-based refinement model at a time of intra prediction of the current block;
- generating a prediction block of the current block using the intra prediction mode;
- and
- generating a residual block of the current block based on the refinement flag,
- wherein, when the refinement flag is 1, generating the residual block includes:
- generating a refined prediction block from the prediction block using the refinement model;
- and
- generating the residual block by subtracting the refined prediction block from the current block,
- wherein, when the refinement flag is 0, generating the residual block includes:
- generating the residual block by subtracting the prediction block from the current block.
Dependencies are inferred from the claim text.