# US 12,010,337 B2 · Encoders, decoders, methods, and video bit streams, and computer programs for hybrid video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,010,337 B2
- Document ID: US12010337B2
- Status: Granted
- Kind: B2
- Application number: 17/469,137
- Filed: 2021-09-08
- Published: 2021-12-30
- Granted: 2024-06-11
- Earliest claimed: 2019-03-12
- Assignees: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
- Applicants: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.
- Inventors: Benjamin Bross; Martin Winken; Anastasia Henkel; Paul Keydel; Ivan Zupancic; Heiko Schwarz; Detlev Marpe; Thomas Wiegand
- Web page: https://patentgrep.com/patent/US12010337B2

## CPC

- H04N 19/52: by predictive encoding
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/134: characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/186: the unit being a colour or a chrominance component
- H04N 19/523: with sub-pixel accuracy
- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/82: involving filtering within a prediction loop
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An encoder for hybrid video coding, the encoder for providing an encoded representation of a video sequence on the basis of an input video content, and the encoder configured to: determine one or more syntax elements related to a portion of the video sequence; select a processing scheme to be applied to the portion of the video sequence based a property described by on the one or more syntax elements, the processing scheme for acquiring a sample for a motion-compensated prediction at an integer and/or fractional location within the portion of the video sequence; encode an index indicating the selected processing scheme such that a given encoded index value represents different processing schemes depending on the property described by the one or more syntax elements; and provide, as the encoded representation of the video sequence, a bit stream including the one or more syntax elements and the encoded index.

## Claims

### Claim 1

A video encoder configured to:
encode syntax elements comprising an indication of an adaptive motion vector resolution (AMVR) mode and an indication of whether an inter prediction mode is translational or affine for a coding block of a picture;
select, depending on the indicated AMVR mode and the indication of whether the inter prediction mode is translational or affine, a finite impulse response (FIR) interpolation filter from a plurality of FIR interpolation filters for obtaining a sample corresponding to a half-sample position of a reference picture of the coding block, the plurality of FIR interpolation filters comprising an interpolation filter with 6 nonzero coefficients of 3, 9, 20, 20, 9, 3 and an interpolation filter with 8 nonzero coefficients of −1, 4, −11, 40, 40, −11, 4, −1;
apply the selected FIR interpolation filter to samples of the reference picture to obtain the sample corresponding to the half-sample position; and
predict a sample of the coding block using the sample corresponding to the half-sample position.

### Claim 2

A video decoder configured to:
decode from a video bit stream syntax elements, the syntax elements comprising an indication of an adaptive motion vector resolution (AMVR) mode and an indication of whether an inter prediction mode is translational or affine for a coding block of a picture;
select, depending on the indicated AMVR mode and the indication of whether the inter prediction mode is translational or affine, a finite impulse response (FIR) interpolation filter from a plurality of FIR interpolation filters for obtaining a sample corresponding to a half-sample position of a reference picture of the coding block, the plurality of FIR interpolation filters comprising an interpolation filter with 6 nonzero coefficients of 3, 9, 20, 20, 9, 3 and an interpolation filter with 8 nonzero coefficients of −1, 4, −11, 40, 40, −11, 4, −1;
apply the selected FIR interpolation filter to samples of the reference picture to obtain the sample corresponding to the half-sample position; and
predict a sample of the coding block using the sample corresponding to the half-sample position.

### Claim 3 (depends on 2)

The video decoder of claim 2, wherein the plurality of FIR interpolation filters comprises more than one filter with 6 nonzero coefficients.

### Claim 4 (depends on 2)

The video decoder of claim 2, wherein none of the syntax elements is explicitly dedicated for indicating the selected FIR interpolation filter.

### Claim 5 (depends on 2)

The video decoder of claim 2, wherein the video decoder is configured to select an FIR interpolation filter individually for different coding units of the picture.

### Claim 6 (depends on 5)

The video decoder of claim 5, wherein the syntax elements further comprise a size of the coding block.

### Claim 7 (depends on 2)

The video decoder of claim 2, wherein the syntax elements further comprise a syntax element indicating a property of a reference picture.

### Claim 8

A method of video encoding, the method comprising:
encoding syntax elements comprising an indication of an adaptive motion vector resolution (AMVR) mode and an indication of whether an inter prediction mode is translational or affine for a coding block of a picture;
selecting, depending on the indicated AMVR mode and the indication of whether the inter prediction mode is translational or affine, a finite impulse response (FIR) interpolation filter from a plurality of FIR interpolation filters for obtaining a sample corresponding to a half-sample position of a reference picture of the coding block, the plurality of FIR interpolation filters comprising an interpolation filter with 6 nonzero coefficients of 3, 9, 20, 20, 9, 3 and an interpolation filter with 8 nonzero coefficients of −1, 4, −11, 40, 40, −11, 4, −1;
applying the selected FIR interpolation filter to samples of the reference picture to obtain the sample corresponding to the half-sample position; and
predicting a sample of the coding block using the sample corresponding to the half-sample position.

### Claim 9

A method for video decoding, the method comprising:
decoding from a video bit stream syntax elements, the syntax elements comprising an indication of an adaptive motion vector resolution (AMVR) mode and an indication of whether an inter prediction mode is translational or affine for a coding block of a picture;
selecting, depending on the indicated AMVR mode and the indication of whether the inter prediction mode is translational or affine, a finite impulse response (FIR) interpolation filter from a plurality of FIR interpolation filters for obtaining a sample corresponding to a half-sample position of a reference picture of the coding block, the plurality of FIR interpolation filters comprising an interpolation filter with 6 nonzero coefficients of 3, 9, 20, 20, 9, 3 and an interpolation filter with 8 nonzero coefficients of −1, 4, −11, 40, 40, −11, 4, −1;
applying the selected FIR interpolation filter to samples of the reference picture to obtain the sample corresponding to the half-sample position; and
predicting a sample of the coding block using the sample corresponding to the half-sample position.

### Claim 10 (depends on 9)

The method of claim 9, wherein the plurality of FIR interpolation filters comprises more than one filter with 6 nonzero coefficients.

### Claim 11 (depends on 9)

The method of claim 9, wherein none of the syntax elements is explicitly dedicated for indicating the selected FIR interpolation filter.

### Claim 12 (depends on 9)

The method of claim 9, further comprising selecting an FIR interpolation filter differently for different coding units of the picture.

### Claim 13

A non-transitory computer readable storage medium comprising instructions, which when executed by at least one processor cause the at least one processor to perform the steps of:
encoding syntax elements comprising an indication of an adaptive motion vector resolution (AMVR) mode and an indication of whether an inter prediction mode is translational or affine for a coding block of a picture;
selecting, depending on the indicated AMVR mode and the indication of whether the inter prediction mode is translational or affine, a finite impulse response (FIR) interpolation filter from a plurality of FIR interpolation filters for obtaining a sample corresponding to a half-sample position of a reference picture of the coding block, the plurality of FIR interpolation filters comprising an interpolation filter with 6 nonzero coefficients of 3, 9, 20, 20, 9, 3 and an interpolation filter with 8 nonzero coefficients of −1, 4, −11, 40, 40, −11, 4, −1;
applying the selected FIR interpolation filter to samples of the reference picture to obtain the sample corresponding to the half-sample position; and
predicting a sample of the coding block using the sample corresponding to the half-sample position.

### Claim 14

A non-transitory computer readable storage medium comprising instructions, which when executed by at least one processor cause the at least one processor to perform the steps of:
decoding from a video bit stream syntax elements, the syntax elements comprising an indication of an adaptive motion vector resolution (AMVR) mode and an indication of whether an inter prediction mode is translational or affine for a coding block of a picture;
selecting, depending on the indicated AMVR mode and the indication of whether the inter prediction mode is translational or affine, a finite impulse response (FIR) interpolation filter from a plurality of FIR interpolation filters for obtaining a sample corresponding to a half-sample position of a reference picture of the coding block, the plurality of FIR interpolation filters comprising an interpolation filter with 6 nonzero coefficients of 3, 9, 20, 20, 9, 3 and an interpolation filter with 8 nonzero coefficients of −1, 4, −11, 40, 40, −11, 4, −1;
applying the selected FIR interpolation filter to samples of the reference picture to obtain the sample corresponding to the half-sample position; and
predicting a sample of the coding block using the sample corresponding to the half-sample position.

### Claim 15 (depends on 14)

The non-transitory computer readable storage medium of claim 14, wherein the plurality of FIR interpolation filters comprises more than one filter with 6 nonzero coefficients.

### Claim 16 (depends on 14)

The non-transitory computer readable storage medium of claim 14, wherein none of the syntax elements is explicitly dedicated for indicating the selected FIR interpolation filter.

### Claim 17 (depends on 14)

The non-transitory computer readable storage medium of claim 14, further comprising selecting an FIR interpolation filter differently for different coding units of the picture.