# US 5,347,312 A · Motion compensated video signal processing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 5,347,312 A - Document ID: US5347312A - Status: Granted - Kind: A - Application number: 07/988,440 - Filed: 1992-12-09 - Granted: 1994-09-13 - Earliest claimed: 1992-01-24 - Assignees: Sony United Kingdom Limited - Inventors: Nicholas I. Saunders; Stephen M. Keating; Carl W. Walters - Web page: https://patentgrep.com/patent/US5347312A ## CPC - H04N 7/014: {involving the use of motion vectors (motion estimation and compensation in video coding H04N19/51)} - H04N 5/145: {Movement estimation (for video coding H04N19/51)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Pairs of temporally adjacent input images are interpolated to produce motion compensated images using motion vectors generated from said but not all of the pairs of input images from which the output images are interpolated. ## Claims ### Claim 1 Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising: a motion vector processor for generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images; selecting means for selecting one of said sets of motion vectors for each of said corresponding output images; and motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images. ### Claim 2 (depends on 1) Video signal processing apparatus according to claim 1, further comprising: means for receiving an interlaced video signal comprising successive video frames, each frame comprising two video fields; and a progressive scan converter for respectively converting pairs of temporally adjacent video fields in said interlaced video signal into said input images of said input video signal; and in which said motion vector processor is operable to generate sets of motion vectors only from pairs of temporally adjacent input images originating from a single frame of said interlaced video signal. ### Claim 3 (depends on 1) Video signal processing apparatus according to claim 1, further comprising: means for receiving an interlaced video signal comprising successive video frames, each frame comprising two video fields; and a progressive scan converter for respectively converting pairs of temporally adjacent video fields in said interlaced video signal into said input images of said input video signal; and in which said motion vector processor is operable to generate sets of motion vectors only from pairs of temporally adjacent input images originating from different adjacent frames of said interlaced video signal. ### Claim 4 (depends on 1) Video signal processing apparatus according to claim 1, in which said output video signal comprises a plurality of interlaced video fields. ### Claim 5 (depends on 1) Video signal processing apparatus according to claim 1, in which said input video signal comprises a plurality of video frames. ### Claim 6 (depends on 5) Video signal processing apparatus according to claim 5, further comprising: means for receiving an interlaced video signal comprising pairs of temporally adjacent video fields; and a progressive scan converter for respectively converting said pairs of temporally adjacent video fields in said interlaced video signal into said input images of said input video signal. ### Claim 7 (depends on 1) Video signal processing apparatus according to claim 1, further comprising: an analyzer for performing a predetermined test for each set of motion vectors to obtain a respective test result indicative of a degree of correlation between said pair of temporally adjacent input images from which that set of motion vectors was generated and for detecting a change of at least a predetermined size in the test results obtained for successive sets of motion vectors as an indication of a possible scene change in said input video signal; and in which said motion compensated interpolating means is operable to interpolate as a function of the possible scene change indication. ### Claim 8 (depends on 7) Video signal processing apparatus according to claim 7, in which: said motion compensated interpolating means is operable to interpolate an output image from a pair of temporally adjacent input images using said selected set of motion vectors when a possible scene change is not indicated, and to generate an output image by intra-image processing of one of said pair of input images when a possible scene change is indicated. ### Claim 9 (depends on 8) Video signal processing apparatus according to claim 8, in which, when a possible scene change is indicated and said selected set of motion vectors is not a set generated from a pair of input images corresponding to an output image to be interpolated, said selecting means is operable to select a different set of motion vectors for use in interpolation of that output image. ### Claim 10 (depends on 1) Video signal processing apparatus according to claim 1, in which said motion vector processor is operable to generate sets of motion vectors only from pairs of temporally adjacent input images corresponding to a subset of said output images. ### Claim 11 (depends on 1) Video signal processing apparatus according to claim 1, in which said subset comprises alternate ones of said output images. ### Claim 12 (depends on 10) Video signal processing apparatus according to claim 10, in which: for an output image in said subset, said selecting means is operable to select said set of motion vectors generated from a pair of input images corresponding to that output image; and for an output image not in said subset, said selecting means is operable to select a set of motion vectors generated from a pair of input images corresponding to another output image temporally adjacent to that output image. ### Claim 13 (depends on 12) Video signal processing apparatus according to claim 12, in which, for an output image not in said subset, said selecting means is operable to select a set of motion vectors generated from a pair of input images corresponding to an output image temporally preceding that output image. ### Claim 14 (depends on 12) Video signal processing apparatus according to claim 12, in which, for an output image not in said subset, said selecting means is operable to select a set of motion vectors generated from a pair of temporally adjacent input images which is closest to a temporal position of that output image. ### Claim 15 Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising: a motion vector processor for generating sets of motion vectors only from pairs of temporally adjacent input images corresponding to a subset of said output images; selecting means for selecting, for an output image in said subset, the set of motion vectors generated from a pair of input images corresponding to that output image, and for selecting, for an output image not in said subset, a set of motion vectors generated from a pair of temporally adjacent input images which is closest to a temporal position of that output image, said selecting means including means for assigning an index number to each of said input images, each said index number representing a temporal position of a respective input image, means for calculating an index number representing a temporal position of each of said output images, and means for selecting a set of motion vectors, for use in interpolation of an output image, generated from a pair of input images having index numbers closest to said index number of that output image; and motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images. ### Claim 16 Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising: a motion vector processor for generating sets of motion vectors only from pairs of temporally adjacent input images corresponding to a subset of said output images; selecting means for selecting, for an output image in said subset, the set of motion vectors generated from a pair of input images corresponding to that output image, and for selecting, for an output image not in said subset, a set of motion vectors generated from a pair of temporally adjacent input images which is closest to a temporal position of that output image, said selecting means including a switchable delay for selectively delaying said sets of motion vectors for use in interpolating an output image not in said subset, thereby selecting between a current set of motion vectors and a previous set of motion vectors; and motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images. ### Claim 17 Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising: a motion vector processor for generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images; selecting means for selecting one of said sets of motion vectors for each of said corresponding output images; an analyzer for performing a predetermined test for each set of motion vectors to obtain a respective test result indicative of a degree of correlation between said pair of temporally adjacent input images from which that set of motion vectors was generated and for detecting a change of at least a predetermined size in said test results obtained for successive sets of motion vectors, thereby indicating a possible scene change in said input video signal; and motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images when a possible scene change is not indicated, and for performing intra-image processing of respective images of said pairs of temporally adjacent input images to produce said corresponding output images when a possible scene change is indicated, said motion compensated interpolating means including means for receiving a control signal indicative of a temporal position of an output image to be interpolated wit respect to temporal positions of said corresponding pair of temporally adjacent input images; means responsive to said control signal for setting relative proportions of said corresponding pair of input images to be used in interpolation of said output image in dependence on said temporal position of said output image when a possible scene change is not indicated; means for setting the relative proportions of the corresponding pair of input images to be used in interpolation of said output image so that said output image depends on the content of a selected one of said pair of input images when a possible scene change is indicated; and interpolation means for generating said output image by combining said corresponding pair of input images according to said relative proportions. ### Claim 18 (depends on 17) Video signal processing apparatus according to claim 17, in which said selected one of said pair of input images is that input image which is temporally closest to said output image. ### Claim 19 Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising: a motion vector processor for generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images; an analyzer for performing a predetermined test for each set of motion vectors to obtain a respective test result indicative of a degree of correlation between said pair of temporally adjacent input images from which that set of motion vectors was generated and for detecting a change of at least a predetermined size in said test results obtained for successive sets of motion vectors, thereby indicating a possible scene change in said input video signal; selecting means for selecting one of said sets of motion vectors for each of said corresponding output images and for selecting a different set of motion vectors when a possible scene change is indicated and the selected set of motion vectors was not generated from the pair of input images corresponding to the respective output image; and motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images when a possible scene change is not indicated, and for performing intra-image processing of respective images of said pairs of temporally adjacent input images to produce said corresponding output images when a possible scene change is indicated, said motion compensated interpolating means including means for setting said set of motion vectors to be used in interpolation to a set of zero motion vectors when a possible scene change is indicated. ### Claim 20 Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising: an image store for storing at least one of said pair of input images from which a corresponding output image is to be interpolated; a motion vector processor for generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images; selecting means for selecting one of said sets of motion vectors for each of said corresponding output images; an analyzer for performing a predetermined test for each set of motion vectors to obtain a respective test result indicative of a degree of correlation between said pair of temporally adjacent input images from which that set of motion vectors was generated and for detecting a change of at least a predetermined size in said test results obtained for successive sets of motion vectors, thereby indicating a possible scene change in said input video signal; motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images; and means responsive to said analyzer indicating a possible scene change for setting said output image to be equal to at least a portion of a stored input image. ### Claim 21 Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising: a motion vector processor for generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images and including means for performing a predetermined confidence test on each motion vector in a set of motion vectors; selecting means for selecting one of said sets of motion vectors for each of said corresponding output images; an analyzer for performing a predetermined test for each set of motion vectors to obtain a respective test result indicative of a degree of correlation between said pair of temporally adjacent input images from which that set of motion vectors was generated and for detecting a change of at least a predetermined size in said test results obtained for successive sets of motion vectors, thereby indicating a possible scene change in said input video signal, said analyzer including means for generating a test result dependent upon a proportion of motion vectors, in a set of motion vectors, which passed said confidence test; and motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images. ### Claim 22 Video signal processing apparatus for interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said video signal processing apparatus comprising: a motion vector processor for generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images and including means for detecting a predetermined number of most commonly occurring motion vectors in a set of motion vectors; selecting means for selecting one of said sets of motion vectors for each of said corresponding output images; an analyzer for performing a predetermined test for each set of motion vectors to obtain a respective test result indicative of a degree of correlation between said pair of temporally adjacent input images from which that set of motion vectors was generated and for detecting a change of at least a predetermined size in said test results obtained for successive sets of motion vectors, thereby indicating a possible scene change in said input video signal, said analyzer including means for generating a test result dependent upon a sum of frequencies of occurrence of said predetermined number of most commonly occurring motion vectors; and motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images. ### Claim 23 A television standards converter comprising: a motion vector processor for generating sets of motion vectors from some but not all of pairs of temporally adjacent input images of an input video signal at a first rate, said pairs of input images corresponding to output images; selecting means for selecting one of said sets of motion vectors for each of the corresponding output images; and motion compensated interpolating means for interpolating said pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images, said corresponding output images comprising an output video signal at a second rate different than said first rate. ### Claim 24 A method of interpolating pairs of temporally adjacent input images of an input video signal to produce corresponding output images of an output video signal, said method comprising the steps of: generating sets of motion vectors from some but not all of said pairs of temporally adjacent input images corresponding to output images; selecting one of said sets of motion vectors for each of said corresponding output images; and interpolating pairs of temporally adjacent input images to produce said corresponding output images using the set of motion vectors respectively selected for said corresponding output images.