Inter prediction method based on variable coefficient deep learning
AssigneesHyundai Motor Company, Kia Corporation, Ewha University-Industry Collaboration Foundation
InventorsJe Won Kang, Na Young Kim, Jung Kyung Lee, Seung Wook Park, Wha Pyeong Lim
Life of this patent
Estimating the term…
Abstract
An inter prediction method allows a variable coefficient deep learning model to adaptively learn characteristics of a video; transmits a variable coefficient deep learning model parameter generated from the learning from an image encoding device to an image decoding device; and refers to a virtual reference frame generated by the variable coefficient deep learning model.
Claims16
A video decoding method performed by a video decoding apparatus, the video decoding method comprising:
- decoding variable coefficient values, an affine prediction flag, and an encoding mode from a bitstream, the affine prediction flag indicating whether affine motion prediction is applied to a current block, and the encoding mode being an encoding mode for motion information of the current block and indicating a merge mode or an advanced motion vector prediction (AMVP) mode;
- generating a virtual reference frame based on reference frames by using an interpolation model, wherein a variable coefficient network included in the interpolation model is set with the variable coefficient values;
- and
- generating a merge candidate of the current block based on the virtual reference frame and the reference frames when the encoding mode is the merge mode.
A video encoding method performed by a video encoding apparatus, the video encoding method comprising:
- acquiring previously generated variable coefficient values and a preset encoding mode, the encoding mode being an encoding mode for motion information of a current block and indicating a merge mode or an advanced motion vector prediction (AMVP) mode;
- generating a virtual reference frame from reference frames by using an interpolation model, wherein a variable coefficient network included in the interpolation model is set with the variable coefficient values;
- and
- generating a merge candidate of the current block based on the virtual reference frame and the reference frames when the encoding mode is the merge mode.
A method for providing video data to a video decoding device, the method comprising:
- encoding the video data into a bitstream;
- and
- transmitting the bitstream to the video decoding device,
- wherein encoding the video data comprises:
- acquiring previously generated variable coefficient values and a preset encoding mode from a bitstream, the encoding mode being an encoding mode for motion information of a current block and indicating a merge mode or an advanced motion vector prediction (AMVP) mode;
- generating a virtual reference frame from reference frames using an interpolation model, wherein a variable coefficient network included in the interpolation model is set with the variable coefficient values;
- and
- generating a merge candidate of the current block based on the virtual reference frame and the reference frames when the encoding mode is the merge mode.
Dependencies are inferred from the claim text.