# US 2004/0062307 A1 · Method and system for selecting interpolation filter type in video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0062307 A1
- Document ID: US20040062307A1
- Status: Published application
- Kind: A1
- Application number: 10/616,894
- Filed: 2003-07-09
- Published: 2004-04-01
- Earliest claimed: 2002-07-09
- Assignees: Nokia Corporation
- Inventors: Antti Hallapuro; Jani Lainema; Marta Karczewicz
- Web page: https://patentgrep.com/patent/US20040062307A1

## CPC

- H04N 19/577: Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/523: with sub-pixel accuracy
- H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
- H04N 19/587: involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
- H04N 19/80: Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method and system for coding a video sequence based on motion compensated prediction, wherein an interpolation filter is used to generate predicted pixel values for picture blocks in the video sequence. The interpolation filter for use in conjunction with a multi-picture type is shorter or having fewer coefficients than the interpolation filter for use in conjunction with a single-picture type. As such, the complexity of the interpolation filter for the multi-picture type can be reduced. Furthermore, the interpolation filter may be changed based on the characteristics of the block, the size and/or the shape of the block.

## Claims

### Claim 1

A method of encoding a video sequence comprising a number of pictures, in which a picture of the video sequence is divided into blocks and a block of said picture is encoded using one of a number of different types of motion compensated prediction, including at least a single-picture prediction type that employs motion compensated prediction to generate predicted pixel values for the block by using an interpolation filter operating on pixel values of a single reference picture in said video sequence and a multi-picture prediction type that employs motion compensated prediction to generate predicted pixel values for the block by using an interpolation filter operating on pixel values of more than one reference picture in said video sequence, wherein the complexity of the interpolation filter used to generate predicted pixel values for the block is dependent upon a characteristic of the block.

### Claim 2 (depends on 1)

A method according to claim 1, wherein the complexity of the interpolation filter is dependent upon the type of motion compensated prediction used in encoding the block.

### Claim 3 (depends on 1)

A method according to claim 1, wherein the complexity of the interpolation filter is changed by changing the type of the filter.

### Claim 4 (depends on 1)

A method according to claim 1, wherein the complexity of the interpolation filter is reduced when using said multi-picture prediction type to generate predicted pixel values for the block.

### Claim 5 (depends on 3)

A method according to claim 3, wherein the complexity of the interpolation filter is reduced when using said multi-picture prediction type by using a shorter filter.

### Claim 6 (depends on 3)

A method according to claim 3, wherein the complexity of the interpolation filter is reduced when using said multi-picture prediction type by using a filter having fewer coefficients.

### Claim 7 (depends on 1)

A method according to claim 1, wherein the complexity of the interpolation filter is changed dependent upon the size of the block.

### Claim 8 (depends on 1)

A method according to claim 1, wherein the complexity of the interpolation filter is changed dependent upon the shape of the block.

### Claim 9 (depends on 1)

A method according to claim 1, wherein the interpolation filter operating on pixel values of more than one reference picture is shorter than the interpolation filter operating on pixel values of a single reference picture.

### Claim 10 (depends on 1)

A method according to claim 1, wherein the interpolation filter operating on pixel values of more than one reference picture comprises a 4-tap filter and the interpolation filter operating on pixel values of a single reference picture comprises a 6-tap filter.

### Claim 11 (depends on 1)

A method according to claim 1, wherein the interpolation filter operating on pixel values of more than one reference picture is dependent on a fractional pixel position in calculating a sub-pixel value.

### Claim 12 (depends on 1)

A method according to claim 1, comprising defining a set of interpolation filters for use in connection with a particular prediction type.

### Claim 13 (depends on 12)

A method according to claim 12, comprising providing an indication of a particular one of said set of interpolation filters to be used in motion compensated prediction of a block.

### Claim 14

A coding system for coding a video sequence, the video sequence comprising a number of pictures, in which a picture of the video sequence is divided into blocks and a block of said picture is encoded using one of a number of different types of motion compensated prediction, including at least a single-picture prediction type that employs motion compensated prediction to generate predicted pixel values for the block by using an interpolation filter operating on pixel values of a single reference picture in said video sequence and a multi-picture prediction type that employs motion compensated prediction to generate predicted pixel values for the block by using an interpolation filter operating on pixel values of more than one reference picture in said video sequence, said system comprising:
means for selecting a prediction type to be used in motion compensated prediction encoding of the block; and
means for changing the interpolation filter based on the selected prediction type.

### Claim 15 (depends on 14)

A coding system according to claim 14, wherein said changing means also changes the interpolation filter based on a characteristic of the block.

### Claim 16 (depends on 14)

A coding system according to claim 14, wherein said changing means also changes the interpolation filter based on the size of the block.

### Claim 17 (depends on 14)

A coding system according to claim 14, wherein said changing means also changes the interpolation filter based on the shape of the block.

### Claim 18 (depends on 14)

A coding system according to claim 14, wherein the interpolation filter operating on pixel values of more than one reference picture is shorter than the interpolation filter operating on pixel values of a single reference picture.

### Claim 19 (depends on 14)

A coding system according to claim 14, wherein the interpolation filter operating on pixel values of more than one reference picture has fewer coefficients than the interpolation filter operating on pixel values of a single reference picture.

### Claim 20 (depends on 14)

A coding system according to claim 14, wherein the interpolation filter operating on pixel values of more than one reference picture comprises a 4-tap filter and the interpolation filter operating on pixel values of a single reference picture comprises a 6-tap filter.

### Claim 21 (depends on 14)

A coding system according to claim 14, wherein the interpolation filter operating on pixel values of more than one reference picture is dependent on a fractional pixel position in calculating a sub-pixel value.

### Claim 22

A method of motion compensated prediction for use in a video coding system, in which system a video sequence comprising a number of pictures, in which a picture of the video sequence is divided into blocks and a block of said picture is encoded using one of a number of different types of motion compensated prediction, including at least a single-picture prediction type that employs motion compensated prediction to generate predicted pixel values for the block by using an interpolation filter operating on pixel values of a single reference picture in said video sequence and a multi-picture prediction type that employs motion compensated prediction to generate predicted pixel values for the block by using an interpolation filter operating on pixel values of more than one reference picture in said video sequence, said method comprising:
determining the types of the motion compensated prediction; and
changing the interpolation filter based on the determined types of the motion compensated prediction.

### Claim 23

A method of motion compensated prediction in which an interpolation filter to be used during motion compensated prediction of a picture block is selected in dependence on the type of motion compensated prediction used.

### Claim 24 (depends on 23)

A method according to claim 23, implemented in a video encoder.

### Claim 25 (depends on 23)

A method according to claim 23, implemented in a video decoder.

### Claim 26 (depends on 23)

A method according to claim 23, wherein if the type of motion compensation used is a multi-picture prediction type, in which a prediction for the picture block is formed using more than one reference picture, the selected interpolation filter has fewer coefficients than the interpolation filter that is selected when the type of motion compensated prediction used is a single-picture prediction type, in which a prediction for the picture block is formed using a single reference picture.

### Claim 27 (depends on 23)

A method according to claim 23, wherein the interpolation filter is selected in dependence on a characteristic of the picture block.

### Claim 28 (depends on 23)

A method according to claim 23, wherein the interpolation filter is selected in dependence on the size of the picture block.

### Claim 29 (depends on 23)

A method according to claim 23, wherein the interpolation filter is selected in dependence on the shape of the picture block.

### Claim 30 (depends on 23)

A method according to claim 23, wherein said means for selecting an interpolation filter is operative to select an interpolation filter in dependence on the size of the picture block.

### Claim 31

An apparatus for performing motion compensated prediction comprising means for selecting an interpolation filter to be used during motion compensated prediction of a picture block in dependence on the type of motion compensated prediction used.

### Claim 32 (depends on 31)

An apparatus according to claim 31, implemented in a video encoder.

### Claim 33 (depends on 31)

An apparatus according to claim 31, implemented in a video decoder.

### Claim 34 (depends on 31)

An apparatus according to claim 31, wherein if the type of motion compensation used is a multi-picture prediction type, in which a prediction for the picture block is formed using more than one reference picture, said means for selecting an interpolation filter is operative to select an interpolation filter that has fewer coefficients than an interpolation filter that is selected when the type of motion compensated prediction used is a single-picture prediction type, in which a prediction for the picture block is formed using a single reference picture.

### Claim 35 (depends on 31)

An apparatus according to claim 31, wherein said means for selecting an interpolation filter is operative to select an interpolation filter in dependence on a characteristic of a picture block.

### Claim 36 (depends on 31)

An apparatus according to claim 31, wherein said means for selecting an interpolation filter is operative to select an interpolation filter in dependence on the size of the picture block.

### Claim 37

A video encoder comprising an apparatus for performing motion compensated prediction, wherein said apparatus for performing motion compensated prediction comprises means for selecting an interpolation filter to be used during motion compensated prediction of a picture block in dependence on the type of motion compensated prediction used.

### Claim 38

A video decoder comprising an apparatus for performing motion compensated prediction, wherein said apparatus for performing motion compensated prediction comprises means for selecting an interpolation filter to be used during motion compensated prediction of a picture block in dependence on the type of motion compensated prediction used.
