# US 2001/0024515 A1 · Method and apparatus to interpolate video frames

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2001/0024515 A1
- Document ID: US20010024515A1
- Status: Published application
- Kind: A1
- Application number: 09/205,638
- Filed: 1998-12-03
- Published: 2001-09-27
- Earliest claimed: 1998-12-03
- Assignees: Intel Corporation
- Inventors: FERNANDO C. M. MARTINS; RAJEEB HAZRA
- Web page: https://patentgrep.com/patent/US20010024515A1

## CPC

- G06T 3/4007: based on interpolation, e.g. bilinear interpolation (image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403)
- H04N 7/0137: {dependent on presence/absence of motion, e.g. of motion zones (H04N7/014 takes precedence; movement detection in television signals H04N5/144)}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method comprises, for a plurality of interpolated pixels in an interpolated video frame, classifying an interpolated pixel of the plurality as one of stationary, moving, covered, and uncovered, and then setting components of the interpolated pixel to components of a previous pixel from a previous video frame, the previous pixel corresponding to the interpolated pixel in the video frame. If the interpolated pixel is uncovered, components of the interpolated pixel are set to components of a current pixel from a current video frame if the interpolated pixel is uncovered, the current pixel corresponding to the interpolated pixel in the video frame. If the interpolated pixel is moving, the interpolated pixel is set to a function of the current pixel and the previous pixel.

## Claims

### Claim 1

A method comprising:
for a plurality of interpolated pixels in an interpolated video frame;
classifying an interpolated pixel of the plurality as one of stationary, moving, covered, and uncovered;
setting components of the interpolated pixel to components of a previous pixel from a previous video frame, the previous pixel corresponding to the interpolated pixel in the video frame;
setting components of the interpolated pixel to components of a current pixel from a current video frame if the interpolated pixel is uncovered, the current pixel corresponding to the interpolated pixel in the video frame; and
setting the interpolated pixel to a function of the current pixel and the previous pixel if the interpolated pixel is moving.

### Claim 2 (depends on 1)

The method of claim 1 in which setting components of the interpolated pixel to components of the previous pixel further comprises:
setting interpolated pixel components used to classify the interpolated pixel to corresponding pixel components of the previous pixel;
setting interpolated pixel components not used to classify the interpolated pixel to a function of corresponding non-classified pixel components of the previous pixel and corresponding non-classified pixel components of the current pixel.

### Claim 3 (depends on 1)

The method of claim 1 in which setting components of the interpolated pixel to components of the current pixel further comprises:
setting interpolated pixel components used to classify the interpolated pixel to corresponding pixel components of the current pixel;
setting interpolated pixel components not used to classify the interpolated pixel to a function of corresponding non-classified pixel components of the previous pixel and corresponding non-classified pixel components of the current pixel.

### Claim 4 (depends on 1)

The method of claim 1 in which setting the components of the interpolated pixel to a function of the current pixel and the previous pixel further comprises:
setting the components of the interpolated pixel to a weighted sum of the corresponding components of the current pixel and the previous pixel if the interpolated pixel is moving, the weights of the weighted sum proportional to a position of the interpolated frame between the current frame and the previous frame.

### Claim 5

A data processing device comprising:
a processor;
a machine-readable storage medium coupled to the processor by way of a bus, the storage medium storing a sequence of instructions which, when executed by the processor, cause the data processing device to:
for a plurality of interpolated pixels in an interpolated video frame;
classify an interpolated pixel of the plurality as one of stationary, moving, covered, and uncovered;
set components of the interpolated pixel to components of a previous pixel from a previous video frame, the previous pixel corresponding to the interpolated pixel in the video frame;
set components of the interpolated pixel to components of a current pixel from a current video frame if the interpolated pixel is uncovered, the current pixel corresponding to the interpolated pixel in the video frame; and
set the interpolated pixel to a function of the current pixel and the previous pixel if the interpolated pixel is moving.

### Claim 6 (depends on 5)

The data processing device of claim 5 in which the sequence of instructions, when executed by a data processing device, further cause the data processing device to:
set the interpolated pixel components used to classify the interpolated pixel to corresponding pixel components of the previous pixel;
set the interpolated pixel components not used to classify the interpolated pixel to a function of corresponding non-classified pixel components of the previous pixel and corresponding non-classified pixel components of the current pixel.

### Claim 7 (depends on 5)

The data processing device of claim 5 in which the sequence of instructions, when executed by a data processing device, further cause the data processing device to:
set the interpolated pixel components used to classify the interpolated pixel to corresponding pixel components of the current pixel;
set the interpolated pixel components not used to classify the interpolated pixel to a function of corresponding non-classified pixel components of the previous pixel and corresponding non-classified pixel components of the current pixel.

### Claim 8 (depends on 5)

The data processing device of claim 5 in which the sequence of instructions, when executed by a data processing device, further cause the data processing device to:
set the components of the interpolated pixel to a weighted sum of the corresponding components of the current pixel and the previous pixel if the interpolated pixel is moving, the weights of the weighted sum proportional to a position of the interpolated frame between the current frame and the previous frame.

### Claim 9

A machine-readable medium having stored thereon a sequence of instructions which, when executed by a data processing device, cause the data processing device to:
for a plurality of interpolated pixels in an interpolated video frame;
classify an interpolated pixel of the plurality as one of stationary, moving, covered, and uncovered;
set components of the interpolated pixel to components of a previous pixel from a previous video frame, the previous pixel corresponding to the interpolated pixel in the video frame;
set components of the interpolated pixel to components of a current pixel from a current video frame if the interpolated pixel is uncovered, the current pixel corresponding to the interpolated pixel in the video frame; and
set the interpolated pixel to a function of the current pixel and the previous pixel if the interpolated pixel is moving.

### Claim 10 (depends on 9)

The machine-readable medium of claim 9 in which the sequence of instructions, when executed by a data processing device, further cause the data processing device to:
set the interpolated pixel components used to classify the interpolated pixel to corresponding pixel components of the previous pixel;
set the interpolated pixel components not used to classify the interpolated pixel to a function of corresponding non-classified pixel components of the previous pixel and corresponding non-classified pixel components of the current pixel.

### Claim 11 (depends on 9)

The machine-readable medium of claim 9 in which the sequence of instructions, when executed by a data processing device, further cause the data processing device to:
set the interpolated pixel components used to classify the interpolated pixel to corresponding pixel components of the current pixel;
set the interpolated pixel components not used to classify the interpolated pixel to a function of corresponding non-classified pixel components of the previous pixel and corresponding non-classified pixel components of the current pixel.

### Claim 12 (depends on 9)

The machine-readable medium of claim 9 in which the sequence of instructions, when executed by a data processing device, further cause the data processing device to:
set the components of the interpolated pixel to a weighted sum of the corresponding components of the current pixel and the previous pixel if the interpolated pixel is moving, the weights of the weighted sum proportional to a position of the interpolated frame between the current frame and the previous frame.

### Claim 13

A method comprising:
for a plurality of interpolated pixels in an interpolated video frame;
classifying an interpolated pixel of the plurality as one of stationary, moving, covered, and uncovered;
setting components of the interpolated pixel to components of a current pixel from a current video frame, the current pixel corresponding to the interpolated pixel in the video frame;
setting components of the interpolated pixel to components of a previous pixel from a previous video frame if the interpolated pixel is covered, the previous pixel corresponding to the interpolated pixel in the video frame; and
setting the interpolated pixel to a function of the current pixel and the previous pixel if the interpolated pixel is moving.

### Claim 14 (depends on 13)

The method of claim 13 in which setting components of the interpolated pixel to components of the previous pixel further comprises:
setting interpolated pixel components used to classify the interpolated pixel to corresponding pixel components of the previous pixel;
setting interpolated pixel components not used to classify the interpolated pixel to a function of corresponding non-classified pixel components of the previous pixel and corresponding non-classified pixel components of the current pixel.

### Claim 15 (depends on 13)

The method of claim 13 in which setting components of the interpolated pixel to components of the current pixel further comprises:
setting interpolated pixel components used to classify the interpolated pixel to corresponding pixel components of the current pixel;
setting interpolated pixel components not used to classify the interpolated pixel to a function of corresponding non-classified pixel components of the previous pixel and corresponding non-classified pixel components of the current pixel.

### Claim 16 (depends on 13)

The method of claim 13 in which setting the components of the interpolated pixel to a function of the current pixel and the previous pixel further comprises:
setting the components of the interpolated pixel to a weighted sum of the corresponding components of the current pixel and the previous pixel if the interpolated pixel is moving, the weights of the weighted sum proportional to a position of the interpolated frame between the current frame and the previous frame.

### Claim 17

A data processing device comprising:
a processor;
a machine-readable storage medium coupled to the processor by way of a bus, the storage medium storing a sequence of instructions which, when executed by the processor, cause the data processing device to:
for a plurality of interpolated pixels in an interpolated video frame;
classify an interpolated pixel of the plurality as one of stationary, moving, covered, and uncovered;
set components of the interpolated pixel to components of a current pixel from a current video frame, the current pixel corresponding to the interpolated pixel in the video frame;
set components of the interpolated pixel to components of a previous pixel from a previous video frame if the interpolated pixel is uncovered, the previous pixel corresponding to the interpolated pixel in the video frame; and
set the interpolated pixel to a function of the current pixel and the previous pixel if the interpolated pixel is moving.

### Claim 18 (depends on 17)

The data processing device of claim 17 in which the sequence of instructions, when executed by a data processing device, further cause the data processing device to:
set the interpolated pixel components used to classify the interpolated pixel to corresponding pixel components of the previous pixel;
set the interpolated pixel components not used to classify the interpolated pixel to a function of corresponding non-classified pixel components of the previous pixel and corresponding non-classified pixel components of the current pixel.

### Claim 19 (depends on 17)

The data processing device of claim 17 in which the sequence of instructions, when executed by a data processing device, further cause the data processing device to:
set the interpolated pixel components used to classify the interpolated pixel to corresponding pixel components of the current pixel;
set the interpolated pixel components not used to classify the interpolated pixel to a function of corresponding non-classified pixel components of the previous pixel and corresponding non-classified pixel components of the current pixel.

### Claim 20 (depends on 17)

The data processing device of claim 17 in which the sequence of instructions, when executed by a data processing device, further cause the data processing device to:
set the components of the interpolated pixel to a weighted sum of the corresponding components of the current pixel and the previous pixel if the interpolated pixel is moving, the weights of the weighted sum proportional to a position of the interpolated frame between the current frame and the previous frame.

### Claim 21

A machine-readable medium having stored thereon a sequence of instructions which, when executed by a data processing device, cause the data processing device to:
for a plurality of interpolated pixels in an interpolated video frame;
classify an interpolated pixel of the plurality as one of stationary,
moving, covered, and uncovered;
set components of the interpolated pixel to components of a current pixel from a current video frame, the current pixel corresponding to the interpolated pixel in the video frame;
set components of the interpolated pixel to components of a previous pixel from a previous video frame if the interpolated pixel is uncovered, the previous pixel corresponding to the interpolated pixel in the video frame; and
set the interpolated pixel to a function of the current pixel and the previous pixel if the interpolated pixel is moving.

### Claim 22 (depends on 21)

The machine-readable medium of claim 21 in which the sequence of instructions, when executed by a data processing device, further cause the data processing device to:
set the interpolated pixel components used to classify the interpolated pixel to corresponding pixel components of the previous pixel;
set the interpolated pixel components not used to classify the interpolated pixel to a function of corresponding non-classified pixel components of the previous pixel and corresponding non-classified pixel components of the current pixel.

### Claim 23 (depends on 21)

The machine-readable medium of claim 21 in which the sequence of instructions, when executed by a data processing device, further cause the data processing device to:
set the interpolated pixel components used to classify the interpolated pixel to corresponding pixel components of the current pixel;
set the interpolated pixel components not used to classify the interpolated pixel to a function of corresponding non-classified pixel components of the previous pixel and corresponding non-classified pixel components of the current pixel.

### Claim 24 (depends on 21)

The machine-readable medium of claim 21 in which the sequence of instructions, when executed by a data processing device, further cause the data processing device to:
set the components of the interpolated pixel to a weighted sum of the corresponding components of the current pixel and the previous pixel if the interpolated pixel is moving, the weights of the weighted sum proportional to a position of the interpolated frame between the current frame and the previous frame.
