Systems and methods for adaptive selection of weights for video coding

An apparatus comprising:

• a memory configured to store video data;
• and
• a processor configured to:
• obtain a current block of a picture of the video data;
• obtain a pre-defined set of weights including pre-defined values for template matching based motion compensation, the pre-defined set of weights comprising at least a first pair of weights and a second pair of weights;
• apply a first weight of the first pair of weights of the pre-defined set of weights to one or more spatially neighboring samples of a first reference frame, the first weight of the first pair of weights having a first pre-defined value;
• apply a second weight of the first pair of weights of the pre-defined set of weights to one or more spatially neighboring samples of a second reference frame, the second weight of the first pair of weights having a second pre-defined value;
• based on applying the first weight of the first pair of weights to the one or more spatially neighboring samples of the first reference frame and applying the second weight of the first pair of weights to the one or more spatially neighboring samples of the second reference frame, determine a first metric associated with one or more spatially neighboring samples of the current block, the one or more spatially neighboring samples of a first reference frame, and the one or more spatially neighboring samples of a second reference frame;
• apply a first weight of the second pair of weights of the pre-defined set of weights to the one or more spatially neighboring samples of the first reference frame, the first weight of the second pair of weights having a third pre-defined value;
• apply a second weight of the second pair of weights of the pre-defined set of weights to the one or more spatially neighboring samples of the second reference frame, the second weight of the second pair of weights having a fourth pre-defined value;
• based on applying the first weight of the second pair of weights to the one or more spatially neighboring samples of the first reference frame and applying the second weight of the second pair of weights to the one or more spatially neighboring samples of the second reference frame, determine a second metric associated with the one or more spatially neighboring samples of the current block, the one or more spatially neighboring samples of the first reference frame, and the one or more spatially neighboring samples of the second reference frame;
• compare the first metric and the second metric;
• determine the first metric is smaller than the second metric;
• selecting the first pair of weights as a selected pair of weights based on the first metric being smaller than the second metric;
• and
• generate a template matching based motion compensation prediction for the current block based on the template matching based motion compensation for the current block using the selected pair of weights.

A non-transitory computer-readable medium having stored thereon instructions that, when executed by one or more processors, cause the one or more processors to:

• obtain a current block of a picture of video data;
• obtain a pre-defined set of weights including pre-defined values for template matching based motion compensation, the pre-defined set of weights comprising at least a first pair of weights and a second pair of weights;
• apply a first weight of the first pair of weights of the pre-defined set of weights to one or more spatially neighboring samples of a first reference frame, the first weight of the first pair of weights having a first pre-defined value;
• apply a second weight of the first pair of weights of the pre-defined set of weights to one or more spatially neighboring samples of a second reference frame, the second weight of the first pair of weights having a second pre-defined value;
• based on applying the first weight of the first pair of weights to the one or more spatially neighboring samples of the first reference frame and applying the second weight of the first pair of weights to the one or more spatially neighboring samples of the second reference frame, determine a first metric associated with one or more spatially neighboring samples of the current block, the one or more spatially neighboring samples of a first reference frame, and the one or more spatially neighboring samples of a second reference frame;
• apply a first weight of the second pair of weights of the pre-defined set of weights to the one or more spatially neighboring samples of the first reference frame, the first weight of the second pair of weights having a third pre-defined value;
• apply a second weight of the second pair of weights of the pre-defined set of weights to the one or more spatially neighboring samples of the second reference frame, the second weight of the second pair of weights having a fourth pre-defined value;
• based on applying the first weight of the second pair of weights to the one or more spatially neighboring samples of the first reference frame and applying the second weight of the second pair of weights to the one or more spatially neighboring samples of the second reference frame, determine a second metric associated with the one or more spatially neighboring samples of the current block, the one or more spatially neighboring samples of the first reference frame, and the one or more spatially neighboring samples of the second reference frame;
• compare the first metric and the second metric;
• determine the first metric is smaller than the second metric;
• select the first pair of weights as a selected pair of weights based on the first metric being smaller than the second metric;
• and
• generate a template matching based motion compensation prediction for the current block based on the selected pair of weights.

An apparatus for processing video data, comprising:

• means for obtaining a current block of a picture of the video data;
• means for obtaining a pre-defined set of weights including pre-defined values for template matching based motion compensation, the pre-defined set of weights comprising at least a first pair of weights and a second pair of weights;
• means for applying a first weight of the first pair of weights of the pre-defined set of weights to one or more spatially neighboring samples of a first reference frame, the first weight of the first pair of weights having a first pre-defined value;
• means for applying a second weight of the first pair of weights of the pre-defined set of weights to one or more spatially neighboring samples of a second reference frame, the second weight of the first pair of weights having a second pre-defined value;
• means for determining, based on applying the first weight of the first pair of weights to the one or more spatially neighboring samples of the first reference frame and applying the second weight of the first pair of weights to the one or more spatially neighboring samples of the second reference frame, a first metric associated with one or more spatially neighboring samples of the current block, the one or more spatially neighboring samples of a first reference frame, and the one or more spatially neighboring samples of a second reference frame;
• means for applying a first weight of the second pair of weights of the pre-defined set of weights to the one or more spatially neighboring samples of the first reference frame, the first weight of the second pair of weights having a third pre-defined value;
• means for applying a second weight of the second pair of weights of the pre-defined set of weights to the one or more spatially neighboring samples of the second reference frame, the second weight of the second pair of weights having a fourth pre-defined value;
• means for determining, based on applying the first weight of the second pair of weights to the one or more spatially neighboring samples of the first reference frame and applying the second weight of the second pair of weights to the one or more spatially neighboring samples of the second reference frame, a second metric associated with the one or more spatially neighboring samples of the current block, the one or more spatially neighboring samples of the first reference frame, and the one or more spatially neighboring samples of the second reference frame;
• means for comparing the first metric and the second metric;
• means for determining the first metric is smaller than the second metric;
• means for selecting the first pair of weights as a selected pair of weights based on the first metric being smaller than the second metric;
• and
• means for generating a template matching based motion compensation prediction for the current block based on the selected pair of weights the template matching based motion compensation for the current block using the selected pair of weights.