Video Coding Based on Global Motion Compensated Motion Vector Predictors

A method for reconstructing a block of a video frame from a bitstream encoded by an encoder apparatus, the method comprising:

• a processor of a decoder apparatus receiving a bitstream comprising a current block of a current video frame to be reconstructed by the decoder apparatus based an already decoded prediction block of a first reference video frame stored in the memory of the decoder apparatus and based on a motion vector representing an offset of the current block relative to the prediction block, wherein a difference between the prediction block and the current block defines a residual block;
• the processor using an entropy coding process to decode the bitstream into a residual block, a motion vector difference, an indication that the motion vector difference is based on a difference between a motion vector and a compensated motion vector predictor, an indication of a selected compensated motion vector predictor, and conversion information for converting a motion vector predictor into a compensated motion vector predictor;
• the processor determining motion vector predictor candidates for predicting the motion vector of the current block, a motion vector predictor candidate defining a motion vector of an already decoded block of the current video frame or a motion vector of an already decoded block of a reference video frame stored in the memory of the encoder apparatus;
• the processor using the conversion information for determining a motion compensation vector for each of the motion vector predictor candidates, a motion compensation vector providing an estimate of a part of a motion vector predictor candidate that is associated with global motion, the global motion caused by movement of a video capturing device relative to a scene;
• the processor determining global motion compensated motion vector predictor candidates, each of the compensated motion vector predictor candidates being determined based on a difference between a motion vector predictor candidate and an associated motion compensation vector;
• selecting a compensated motion vector predictor from the compensated motion vector predictor candidates based on the indication of a selected compensated motion vector predictor;
• and determining the motion vector of the current block based on the compensated motion vector predictor and the motion vector difference;
• and
• the processor reconstructing the current block on the basis of the prediction block and the residual block, the reconstruction including using the motion vector to identify the prediction block of the reference video frame stored in the memory of the decoder apparatus.

An encoder apparatus comprising:

• a processor;
• and
• computer-readable storage storing instructions that, when executed by the processor, cause the encoder apparatus to carry out operations including:
• determining a motion vector of a current block of a current video frame of a sequence of video frames comprising video data captured by a video capturing device, the motion vector defining an offset of the current block relative to a prediction block of an already encoded first reference video frame stored in a memory of the encoder apparatus, wherein at least part of the offset is associated with global motion in the video data when the video capturing device is moving relative to a scene, and wherein a difference between the current block and the prediction block defines a residual block,
• determining or receiving a motion compensation vector for each of the motion vector predictor candidates, a motion compensation vector providing an estimate of a part of a motion vector predictor candidate that is associated with global motion,
• determining or receiving a motion compensation vector for each of the motion vector predictor candidates, a motion compensation vector representing an estimate of global motion of pixels of an already encoded bock of the current video frame or an already encoded block of one of the one or more reference video frames, the global motion resulting from movement of the video capturing device relative to the scene,
• determining global motion compensated motion vector predictor candidates, each of the compensated motion vector predictor candidates being determined based on a difference between a motion vector predictor candidate and an associated motion compensation vector;
• selecting a compensated motion vector predictor from the global motion compensated motion vector predictor candidates;
• and determining a motion vector difference based on the compensated motion vector predictor and the motion vector, and
• using an entropy coding algorithm to code into the bitstream the residual block, the motion vector difference, an indication that the motion vector difference is based on a difference between the motion vector and a compensated motion vector predictor;
• an indication of the selected compensated motion vector predictor;
• and conversion information for converting a motion vector predictor into a compensated motion vector predictor.

A decoder apparatus comprising:

• a processor;
• and
• computer-readable storage storing instructions that, when executed by the processor, cause the decoder apparatus to carry out operations including:
• receiving a bitstream comprising a current block of a current video frame to be reconstructed by the decoder apparatus based an already decoded prediction block of a first reference video frame stored in the memory of the decoder apparatus and based on a motion vector representing an offset of the current block relative to the prediction block, wherein a difference between the prediction block and the current block defines a residual block,
• using an entropy coding process to decode the bitstream into a residual block, a motion vector difference, an indication that the motion vector difference is based on a difference between a motion vector and a compensated motion vector predictor, an indication of a selected compensated motion vector predictor, and conversion information for converting a motion vector predictor into a compensated motion vector predictor,
• determining motion vector predictor candidates for predicting the motion vector of the current block, a motion vector predictor candidate defining a motion vector of an already decoded block of the current video frame or a motion vector of an already decoded block of a reference video frame stored in the memory of the decoder apparatus,
• using the conversion information for determining a motion compensation vector for each of the motion vector predictor candidates, a motion compensation vector providing an estimate of a part of a motion vector predictor candidate that is associated with global motion, the global motion resulting from movement of a video capturing device relative to a scene,
• determining global motion compensated motion vector predictor candidates, each of the compensated motion vector predictor candidates being determined based on a difference between a motion vector predictor candidate and an associated motion compensation vector;
• selecting a compensated motion vector predictor from the compensated motion vector predictor candidates based on the indication of a selected compensated motion vector predictor;
• and, determining the motion vector of the current block based on the compensated motion vector predictor and the motion vector difference, and
• reconstructing the current block on the basis of the prediction block and the residual block, the reconstruction including using the motion vector to identify the prediction block of the reference video frame stored in the memory of the decoder apparatus.

A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor of an encoder apparatus, cause the encoder apparatus to carry out operations including:

• determining a motion vector of a current block of a current video frame of a sequence of video frames comprising video data captured by a video capturing device, the motion vector defining an offset of the current block relative to a prediction block of an already encoded first reference video frame stored in a memory of the encoder apparatus, wherein at least part of the offset defined by the motion vector is associated with global motion in the video data when the video capturing device is moving relative to a scene, and wherein a difference between the current block and the prediction block defines a residual block;
• determining motion vector predictor candidates for predicting the motion vector, the motion vector predictor candidates being determined by the processor based on one or more motion vectors of one or more already encoded blocks of the current video frame and/or one or more already encoded blocks of one or more reference video frames stored in the memory of the encoder apparatus;
• determining or receiving a motion compensation vector for each of the motion vector predictor candidates, a motion compensation vector providing an estimate of a part of a motion vector predictor candidate that is associated with global motion;
• determining global motion compensated motion vector predictor candidates, each of the compensated motion vector predictor candidates being determined based on a difference between a motion vector predictor candidate and an associated motion compensation vector;
• selecting a compensated motion vector predictor from the global motion compensated motion vector predictor candidates;
• and determining a motion vector difference based on the compensated motion vector predictor and the motion vector;
• and
• using an entropy coding algorithm to code into the bitstream:
• the residual block, the motion vector difference, an indication that the motion vector difference is based on a difference between the motion vector and a compensated motion vector predictor, an indication of the selected compensated motion vector predictor, and conversion information for converting a motion vector predictor into a compensated motion vector predictor.

A non-transitory computer-readable medium having instructions stored thereon that, when executed by a processor of an decoder apparatus, cause the decoder apparatus to carry out operations including:

• a processor of a decoder apparatus receiving a bitstream comprising a current block of a current video frame to be reconstructed by the decoder apparatus based an already decoded prediction block of a first reference video frame stored in the memory of the decoder apparatus and based on a motion vector representing an offset of the current block relative to the prediction block, wherein a difference between the prediction block and the current block defines a residual block;
• the processor using an entropy coding process to decode the bitstream into a residual block, a motion vector difference, an indication that the motion vector difference is based on a difference between a motion vector and a compensated motion vector predictor, an indication of a selected compensated motion vector predictor, and conversion information for converting a motion vector predictor into a compensated motion vector predictor;
• the processor determining motion vector predictor candidates for predicting the motion vector of the current block, a motion vector predictor candidate defining a motion vector of an already decoded block of the current video frame or a motion vector of an already decoded block of a reference video frame stored in the memory of the encoder apparatus;
• the processor using the conversion information for determining a motion compensation vector for each of the motion vector predictor candidates, a motion compensation vector providing an estimate of a part of a motion vector predictor candidate that is associated with global motion, the global motion caused by movement of a video capturing device relative to a scene;
• the processor determining global motion compensated motion vector predictor candidates, each of the compensated motion vector predictor candidates being determined based on a difference between a motion vector predictor candidate and an associated motion compensation vector;
• selecting a compensated motion vector predictor from the compensated motion vector predictor candidates based on the indication of a selected compensated motion vector predictor;
• and determining the motion vector of the current block based on the compensated motion vector predictor and the motion vector difference;
• and
• the processor reconstructing the current block on the basis of the prediction block and the residual block, the reconstruction including using the motion vector to identify the prediction block of the reference video frame stored in the memory of the decoder apparatus.