Motion compensated video signal processing
AssigneeSony United Kingdom Limited
InventorsNicholas I. Saunders, Stephen M. Keating, Carl W. Walters
Life of this patent
Estimating the term…
Abstract
Pairs of temporally adjacent input images are interpolated to produce motion compensated images using motion vectors generated from said but not all of the pairs of input images from which the output images are interpolated.
Claims24
Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising:
- a motion vector processor for generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images;
- selecting means for selecting one of said sets of motion vectors for each of said corresponding output images;
- and
- motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images.
Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising:
- a motion vector processor for generating sets of motion vectors only from pairs of temporally adjacent input images corresponding to a subset of said output images;
- selecting means for selecting, for an output image in said subset, the set of motion vectors generated from a pair of input images corresponding to that output image, and for selecting, for an output image not in said subset, a set of motion vectors generated from a pair of temporally adjacent input images which is closest to a temporal position of that output image, said selecting means including means for assigning an index number to each of said input images, each said index number representing a temporal position of a respective input image, means for calculating an index number representing a temporal position of each of said output images, and means for selecting a set of motion vectors, for use in interpolation of an output image, generated from a pair of input images having index numbers closest to said index number of that output image;
- and
- motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images.
Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising:
- a motion vector processor for generating sets of motion vectors only from pairs of temporally adjacent input images corresponding to a subset of said output images;
- selecting means for selecting, for an output image in said subset, the set of motion vectors generated from a pair of input images corresponding to that output image, and for selecting, for an output image not in said subset, a set of motion vectors generated from a pair of temporally adjacent input images which is closest to a temporal position of that output image, said selecting means including a switchable delay for selectively delaying said sets of motion vectors for use in interpolating an output image not in said subset, thereby selecting between a current set of motion vectors and a previous set of motion vectors;
- and
- motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images.
Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising:
- a motion vector processor for generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images;
- selecting means for selecting one of said sets of motion vectors for each of said corresponding output images;
- an analyzer for performing a predetermined test for each set of motion vectors to obtain a respective test result indicative of a degree of correlation between said pair of temporally adjacent input images from which that set of motion vectors was generated and for detecting a change of at least a predetermined size in said test results obtained for successive sets of motion vectors, thereby indicating a possible scene change in said input video signal;
- and
- motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images when a possible scene change is not indicated, and for performing intra-image processing of respective images of said pairs of temporally adjacent input images to produce said corresponding output images when a possible scene change is indicated, said motion compensated interpolating means including means for receiving a control signal indicative of a temporal position of an output image to be interpolated wit respect to temporal positions of said corresponding pair of temporally adjacent input images;
- means responsive to said control signal for setting relative proportions of said corresponding pair of input images to be used in interpolation of said output image in dependence on said temporal position of said output image when a possible scene change is not indicated;
- means for setting the relative proportions of the corresponding pair of input images to be used in interpolation of said output image so that said output image depends on the content of a selected one of said pair of input images when a possible scene change is indicated;
- and interpolation means for generating said output image by combining said corresponding pair of input images according to said relative proportions.
Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising:
- a motion vector processor for generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images;
- an analyzer for performing a predetermined test for each set of motion vectors to obtain a respective test result indicative of a degree of correlation between said pair of temporally adjacent input images from which that set of motion vectors was generated and for detecting a change of at least a predetermined size in said test results obtained for successive sets of motion vectors, thereby indicating a possible scene change in said input video signal;
- selecting means for selecting one of said sets of motion vectors for each of said corresponding output images and for selecting a different set of motion vectors when a possible scene change is indicated and the selected set of motion vectors was not generated from the pair of input images corresponding to the respective output image;
- and
- motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images when a possible scene change is not indicated, and for performing intra-image processing of respective images of said pairs of temporally adjacent input images to produce said corresponding output images when a possible scene change is indicated, said motion compensated interpolating means including means for setting said set of motion vectors to be used in interpolation to a set of zero motion vectors when a possible scene change is indicated.
Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising:
- an image store for storing at least one of said pair of input images from which a corresponding output image is to be interpolated;
- a motion vector processor for generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images;
- selecting means for selecting one of said sets of motion vectors for each of said corresponding output images;
- an analyzer for performing a predetermined test for each set of motion vectors to obtain a respective test result indicative of a degree of correlation between said pair of temporally adjacent input images from which that set of motion vectors was generated and for detecting a change of at least a predetermined size in said test results obtained for successive sets of motion vectors, thereby indicating a possible scene change in said input video signal;
- motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images;
- and
- means responsive to said analyzer indicating a possible scene change for setting said output image to be equal to at least a portion of a stored input image.
Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising:
- a motion vector processor for generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images and including means for performing a predetermined confidence test on each motion vector in a set of motion vectors;
- selecting means for selecting one of said sets of motion vectors for each of said corresponding output images;
- an analyzer for performing a predetermined test for each set of motion vectors to obtain a respective test result indicative of a degree of correlation between said pair of temporally adjacent input images from which that set of motion vectors was generated and for detecting a change of at least a predetermined size in said test results obtained for successive sets of motion vectors, thereby indicating a possible scene change in said input video signal, said analyzer including means for generating a test result dependent upon a proportion of motion vectors, in a set of motion vectors, which passed said confidence test;
- and
- motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images.
Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising:
- a motion vector processor for generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images and including means for detecting a predetermined number of most commonly occurring motion vectors in a set of motion vectors;
- selecting means for selecting one of said sets of motion vectors for each of said corresponding output images;
- an analyzer for performing a predetermined test for each set of motion vectors to obtain a respective test result indicative of a degree of correlation between said pair of temporally adjacent input images from which that set of motion vectors was generated and for detecting a change of at least a predetermined size in said test results obtained for successive sets of motion vectors, thereby indicating a possible scene change in said input video signal, said analyzer including means for generating a test result dependent upon a sum of frequencies of occurrence of said predetermined number of most commonly occurring motion vectors;
- and
- motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images.
A television standards converter comprising:
- a motion vector processor for generating sets of motion vectors from some but not all of pairs of temporally adjacent input images of an input video signal at a first rate, said pairs of input images corresponding to output images;
- selecting means for selecting one of said sets of motion vectors for each of the corresponding output images;
- and
- motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images, said corresponding output images comprising an output video signal at a second rate different than said first rate.
A method of interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said method comprising the steps of:
- generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images;
- selecting one of said sets of motion vectors for each of said corresponding output images;
- and
- interpolating pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images.
Dependencies are inferred from the claim text.