Choosing video deinterlacing interpolant based on cost
AssigneeMicrosoft Corporation
InventorsShengyang Dai, Simon John Baker, Sing Bing Kang
Life of this patent
Estimating the term…
Abstract
Deinterlacing of video involves converting interlaced video to progressive video by interpolating a missing pixel in the interlaced video from other pixels in the video. A plurality of interpolants are provided, each of which interpolates a pixel value from other pixels that are nearby in space and/or time. The data costs of using the various interpolants is calculated. A particular one of the interpolants is chosen based on the data costs associated with the various interpolants. The chosen interpolant is used to interpolate the value of the missing pixel. The interpolated pixel value may be refined based on exemplars. The exemplars may be taken from the video that is being deinterlaced.
Claims18
One or more computer-readable storage devices comprising executable instructions to perform a method of deinterlacing video, the method comprising:
- calculating data costs of using each of a plurality of interpolants to interpolate a pixel of the video;
- choosing one of said interpolants based on said data costs;
- applying said one of said interpolants to said pixel to produce an interpolated pixel value;
- and
- displaying a result that is based on said interpolated pixel value, a term being calculated based on a pair that comprises said one of said interpolants and a first interpolant used on a first pixel that is in a neighborhood of said pixel, said term being chosen to be a first value where said one of said interpolants and said first interpolant are a spatial-temporal pair, said term being chosen to be a second value that is lower than said first value where said one of said interpolants and said first interpolant are two spatial interpolants or two temporal interpolants.
A method of interpolating a first pixel in interlaced video that is at a first resolution, the method comprising:
- downsampling said interlaced video to create a first instance of first progressive video that is at a second resolution that is lower than said first resolution;
- calculating first data costs associated with using each of a plurality of interpolants to interpolate, based on said first instance, a second pixel in said first instance that corresponds in space and time to said first pixel;
- choosing one of said interpolants based on said first data costs;
- applying said one of said interpolants to the interlaced video to calculate a first value of the first pixel;
- displaying second progressive video at the first resolution, said second progressive video comprising said first pixel with an appearance based on said first value, a term being calculated based on a pair that comprises said one of said interpolants and a first interpolant used on a third pixel that is in a neighborhood of said first pixel, said term being chosen to be a second value where said one of said interpolants and said first interpolant are a spatial-temporal pair, said term being chosen to be a third value that is lower than said second value where said one of said interpolants and said first interpolant are two spatial interpolants or two temporal interpolants.
A system comprising:
- a display;
- an input that receives interlaced video comprising a field having scan lines that alternate as present and not-present;
- an interpolator that interpolates, based on said interlaced video, a pixel of said field that is in a not-present scan line;
- a refiner that adjusts said pixel from a first value to a second value based on an exemplar from said interlaced video;
- a mechanism that causes a progressive frame to be shown on said display, said progressive frame comprising said pixel at said second value;
- and
- a data cost calculator that calculates a data cost of using each of a plurality of interpolants to interpolate said pixel and chooses one of said interpolants based on which of said interpolants has a lowest data cost;
- said interpolator interpolating said pixel using said one of said interpolants chosen by said data cost calculator, a term being calculated based on a pair that comprises said one of said interpolants and a first interpolant used on a first pixel that is in a neighborhood of said pixel, said term being chosen to be a first value where said one of said interpolants and said first interpolant are a spatial-temporal pair, said term being chosen to be a second value that is lower than said first value where said one of said interpolants and said first interpolant are two spatial interpolants or two temporal interpolants.
Dependencies are inferred from the claim text.