Integerization for interpolation filter design in video coding

A non-transitory computer-readable medium having program code that is stored thereon, the program code executable by one or more processing devices for performing operations comprising:

• accessing a plurality of frames of a video;
• performing inter prediction for the plurality of frames using a set of integerized interpolation filters to generate prediction residuals for the plurality of frames, wherein the set of integerized interpolation filters is generated by:
• accessing a set of interpolation filters, each of the set of interpolation filters having floating-point filter coefficients;
• for each interpolation filter in the set of interpolation filters,
• generating two integerized filter coefficient values for each filter coefficient of the interpolation filter,
• generating a set of filter candidates based on the two integerized filter coefficient values for each filter coefficient,
• calculating an error metric for each filter candidate in the set of filter candidates, and
• selecting an integerized interpolation filter for the interpolation filter from the set of filter candidates, the selected integerized interpolation filter having a lowest error metric among the set of filter candidates;
• and
• encoding the prediction residuals for the plurality of frames into a bitstream representing the video.

A method for decoding a video from a video bitstream, the method comprising:

• decoding one or more frames of the video from the video bitstream;
• performing inter prediction based on the one or more frames using a set of integerized interpolation filters to decode another frame of the video, wherein the set of integerized interpolation filters are generated by:
• accessing a set of interpolation filters, each of the set of interpolation filters having floating-point filter coefficients;
• for each interpolation filter in the set of interpolation filters,
• generating two integerized filter coefficient values for each filter coefficient of the interpolation filter,
• generating a set of filter candidates based on the two integerized filter coefficient values for each filter coefficient,
• calculating an error metric for each filter candidate in the set of filter candidates, and
• selecting an integerized interpolation filter for the interpolation filter from the set of filter candidates, the selected integerized interpolation filter having a lowest error metric among the set of filter candidates;
• and
• causing the decoded one or more frame and the decoded another frame to be displayed.