Back to results
US 12,587,669 B2Granted
Motion flow coding for deep learning based YUV video compression
AssigneeInterDigital VC Holdings, Inc.
InventorsFabien Racape, Jean Begaint, Simon Feltman, Akshay Pushparaja
Life of this patent
Estimating the term…
Abstract
Video encoding and decoding is implemented with auto encoders using luminance information to derive motion information for chrominance prediction. In one embodiment YUV 4:2:0 video is encoded and decoded in which luminance information is downsampled to generate predictions from chrominance components of a reference frame. In a related embodiment, more than one reference frame is used for predictions. In another embodiment, convolutions and transpose convolutions implement derivation of motion information.
Claims19
A method, comprising:
- concatenating luminance data of a current and at least one reference block;
- determining motion information from the concatenated luminance data;
- processing said determined motion information with a tanh function and a warping to generate a motion tensor;
- encoding said determined motion information;
- down sampling said encoded motion information;
- determining a prediction of chrominance data based on said downsampled encoded motion information, said motion tensor and chrominance data of the at least one reference block;
- determining a prediction of luminance data based on said encoded motion information, said motion tensor and luminance data of the at least one reference block;
- determining residual data of the current block based on said predictions;
- and, encoding said residual data into a bitstream also comprising said encoded motion information.
6 more elements
An apparatus, comprising:
- a processor, configured to:
- concatenate luminance data of a current and at least one reference block;
- determine motion information from the concatenated luminance data;
- process said determined motion information with a tanh function and a warping to generate a motion tensor;
- encode said determined motion information;
- down sample said encoded motion information;
- determine a prediction of chrominance data based on said downsampled encoded motion information, said motion tensor and chrominance data of the at least one reference block;
- determine a prediction of luminance data based on said encoded motion information, said motion tensor and luminance data of the at least one reference block;
- determine residual data of the current block based on said predictions;
- and, encode said residual data into a bitstream also comprising said encoded motion information.
7 more elements
A method, comprising:
- decoding motion information from a bitstream;
- down sampling said decoded motion information;
- processing said decoded motion information with a tanh function and a warping to generate a motion tensor;
- determining a prediction of chrominance data based on said downsampled decoded motion information, said motion tensor and chrominance data of at least one reference block;
- determining a prediction of luminance data based on said decoded motion information, said motion tensor and luminance data of the at least one reference block;
- decoding residual information;
- and,
- reconstructing a video block using said decoded residual information and said predictions.
5 more elements
An apparatus, comprising:
- a processor, configured to:
- decode motion information from a bitstream;
- down sample said decoded motion information;
- process said decoded motion information with a tanh function and a warping to generate a motion tensor;
- determine a prediction of chrominance data based on said downsampled decoded motion information, said motion tensor and chrominance data of at least one reference block;
- determine a prediction of luminance data based on said decoded motion information, said motion tensor and luminance data of the at least one reference block;
- decode residual information;
- and,
- reconstruct a video block using said decoded residual information and said predictions.
6 more elements
Dependencies are inferred from the claim text.