Enhanced deinterlacing using predictors from motion estimation engine
AssigneeZenverge, Inc.
InventorsAnthony D. Masterson, Alexander N. Kipnis, Dzung Tien Hoang
Life of this patent
Estimating the term…
Abstract
An apparatus and method for generating predictors performs motion estimation of a target macroblock in a target field against data segments in reference fields. The same motion estimation engine is used to perform various image processing operations to efficiently use resources of the apparatus. Different reference fields are used depending on modes of operation. In a deinterlacing mode, deinterlacing is performed using directional interpolation, recursive motion compensated deinterlacing, and motion adaptive deinterlacing.
Claims16
A video deinterlacer for deinterlacing a video sequence, the video sequence including a target input field and reference fields the video deinterlacer comprising:
- a motion estimation engine configured to generate a predictor for a target data segment of an interlaced field of a target output frame from the reference fields, the predictor representing a data segment of the reference fields that best matches the target data segment;
- an image processor coupled to the motion estimation engine and comprising:
- a directional interpolation module configured to generate a first pixel of a deinterlaced field by performing directional interpolation on the interlaced field of the target output frame;
- a recursive motion compensation deinterlacing module configured to generate a second pixel of the deinterlaced field of the target output frame by performing motion compensation on the interlaced field of the target output frame using at least the predictor, a location of the second pixel in the deinterlaced field same as a location of the first pixel in the deinterlaced field;
- a motion adaptive module configured to generate a third pixel of the deinterlaced field of the target output frame by performing blending based on pixels of the reference fields, a location of the third pixel in the deinterlaced field same as the location of the first and second pixels in the deinterlaced field;
- an interleaver configured to generate an intermediate data segment by at least interleaving a pixel of the predictor and the second pixel or the third pixel;
- and
- a blender configured to reduce noise in an output data segment by at least blending the first pixel and a pixel of the intermediate data segment at a location same as the first pixel.
A method of deinterlacing an interlaced video sequence including interlaced target input frame and reference frames, the method comprising:
- generating a predictor for a target data segment of the interlaced field of a target output frame from the reference fields, the predictor representing a data segment of the reference fields that best matches the target data segment;
- generating a first pixel of a deinterlaced field by performing directional interpolation on the interlaced field of the target output frame;
- generating a second pixel of the deinterlaced field of the target output frame by performing motion compensation on the interlaced field of the target frame using at least the predictor, a location of the second pixel in the deinterlaced field same as a location of the first pixel in the deinterlaced field;
- generating a third pixel of the deinterlaced field of the target output frame by performing blending based on pixels of the reference fields, a location of the third pixel in the deinterlaced field same as the location of the first and second pixels in the deinterlaced field;
- interleaving the predictor and the second pixel or the third pixel to generate an intermediate data segment;
- and
- reducing noise in an output data segment by blending the first pixel and a pixel of the intermediate data segment at a location same as the first pixel to generate a pixel of an output data segment.
A method of deinterlacing an interlaced video sequence including a target frame and reference frames, the method comprising:
- generating a deinterlaced field of the target frame from an interlaced target field of the target output frame, an interlaced field of a first previous output frame preceding the target frame, a deinterlaced field of the first previous output frame, an interlaced field of a second previous output frame preceding the first previous output frame, and a first subsequent interlaced field, responsive to a scene change not being detected in the target frame or the first previous output frame;
- and
- generating the deinterlaced field of the target output frame from the interlaced field of the target output frame, the interlaced field of the first subsequent output frame subsequent to the target output frame, an interlaced field of a second subsequent output frame subsequent to the first subsequent output frame, the interlaced field of the first previous output frame, and the deinterlaced field of the first previous output frame, responsive to the scene change being detected in the first previous output frame.
Dependencies are inferred from the claim text.