# US 5,703,650 A · Method of and device for estimating motion in a video signal > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 5,703,650 A - Document ID: US5703650A - Status: Granted - Kind: A - Application number: 08/550,692 - Filed: 1995-10-31 - Granted: 1997-12-30 - Earliest claimed: 1994-10-31 - Assignees: Vistek Electronics Limited - Inventors: Roger N. Robinson - Web page: https://patentgrep.com/patent/US5703650A ## CPC - H04N 5/145: {Movement estimation (for video coding H04N19/51)} - G06T 7/207: for motion estimation over a hierarchy of resolutions (multi-resolution motion estimation or hierarchical motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/53) - G06T 7/238: using non-full search, e.g. three-step search - H04N 19/53: Multi-resolution motion estimation; Hierarchical motion estimation - G06T 2207/10016: Video; Image sequence - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract The method described enables a high accuracy of motion measurement to be achieved with simple circuitry and overcomes some of the most important sources of error introduced in other systems. Many of the previous techniques may be extended by using a hierarchical technique to improve the accuracy or resolution of a simple estimator e.g. hierarchical block matching or successive approximate gradient systems. The invention described in this patent introduces novel techniques of weighted-sample area matching, effectively giving soft boundaries to the picture areas used to assess motion within a picture, and/or with a technique of adjusting the picture resolution between successive stages of motion measurement. The combination of these techniques reduces many of the limitations of previous techniques. ## Claims ### Claim 1 A device for estimating motion in an electronic visual signal, comprising; a first channel for receiving the signal and a second channel for receiving a comparison signal; a first filter arranged to receive said signal; a second filter arranged to receive said comparison signal; a motion estimator coupled to said filters to receive said filtered signal and said comparison filtered signal for estimating the motion in the signal; and a further first filter for prefiltering the signal and providing a prefiltered signal to said first filter, a further second filter for prefiltering the comparison signal and providing a prefiltered comparison signal to said second filter and a further motion estimator coupled to said further filters and arranged to receive the output of said motion estimator for estimating motion in the signal at a higher resolution than the motion estimator. ### Claim 2 (depends on 1) A device as claimed in claim 1, in which said motion estimator provides a vector field to represent motion and further comprising an interpolator coupled to the motion estimator for providing an interpolated vector field of higher resolution than the vector field by estimating intermediate points in the vector field. ### Claim 3 (depends on 2) A device as claimed in claim 2, further comprising a cascade of a plurality of further filters and further motion estimators. ### Claim 4 (depends on 3) A device as claimed in claim 3, further comprising a further interpolator for the or each further motion estimator. ### Claim 5 (depends on 1) A device as claimed in claim 1, in which said comparison signal comprises the signal delayed by one field or frame. ### Claim 6 (depends on 1) A device as claimed in claim 1, in which said comparison signal comprises the signal shifted by a fraction of one line of video. ### Claim 7 (depends on 6) A device as claimed in claim 6, in which the signal is also shifted by an mount represented by=(t-t.sub.1)/(t.sub.2 -t.sub.1).multidot.V and the comparison signal is shifted by an amount represented by=(t.sub.2 -t)/(t.sub.2 -t.sub.1).multidot.V where t.sub.1 represents a point of time in the signal; t.sub.2 represents the point of time in the comparison signal; and V is the total amount of shifted of the signal and comparison signal; and t is the point of time at which to estimate motion. ### Claim 8 (depends on 1) A device as claimed in claim 1, in which said motion estimator or the or each further motion estimator applies weighted factors to a pattern of points in the signal. ### Claim 9 (depends on 1) A device as claimed in claim 1, in which said motion estimator comprises a memory for storing a pattern of pixels in the signal; a second memory for storing the pattern of pixels in a comparison signal; logic means to derive a motion value =.SIGMA..vertline.P.sub.o -P.sub.a .vertline. where P.sub.o is the magnitude of a pixel in the pattern of the signal and P.sub.a is the magnitude of the pixel in the pattern of the comparison signal, characterised by the multiplier means for applying weighted factors to the motion value dependent upon the position of the pixel in the pattern. ### Claim 10 A device for estimating motion in an electronic visual signal, comprising: a first channel for receiving the signal and a second channel for receiving a comparison signal; a first filter arranged to receive said signal; a second filter arranged to receive said comparison signal; a motion estimator coupled to said filters to receive said filtered signal and said comparison filtered signal for estimating the motion in the signal; a further first filter for prefiltering the signal and providing a prefiltered signal to said first filter, a further second filter for prefiltering the comparison signal and providing a prefiltered comparison signal to said second filter and a further motion estimator coupled to said further filters and arranged to receive the output of said motion estimator for estimating motion in the signal at a higher resolution than the motion estimator; a cascade of a plurality of further filters and further motion estimators; and in which said motion estimator or the or each further motion estimator applies weighted factors to a pattern of points in the signal. ### Claim 11 (depends on 10) A device as claimed in claim 10, further comprising an interpolator for the motion estimator and a further interpolator for the or each further motion estimator. ### Claim 12 (depends on 10) A device as chimed in claim 10, in which said comparison signal comprises the signal delayed by one field or frame. ### Claim 13 (depends on 10) A device as claimed in claim 10, in which said comparison signal comprises the signal shifted by a fraction of one line of video. ### Claim 14 (depends on 13) A device as claimed in claim 13, in which the signal is also shifted by an amount represented by=(t-t.sub.1)/(t.sub.2 -t.sub.1).multidot.V and the comparison signal is shifted by an amount represented by=(t.sub.2 -t)/(t.sub.2 -t.sub.1).multidot.V where t.sub.1 represents a point of time in the signal; t.sub.2 represents the point of time in the comparison signal; and V is the total amount of shifted of the signal and comparison signal; and t is the point of time at which to estimate motion. ### Claim 15 (depends on 10) A device as claimed in claim 10, in which said motion estimator or the or each motion estimator comprises: a memory for storing a pattern of pixels in the signal; a second memory for storing the pattern of pixels in a comparison signal; logic means to derive a motion value =.SIGMA..vertline.P.sub.o -P.sub.a .vertline. where P.sub.o is the magnitude of a pixel in the pattern of the signal and P.sub.a is the magnitude of the pixel in the pattern of the comparison signal, characterised by the multiplier means for applying weighted factors to the motion value dependent upon the position of the pixel in the pattern. ### Claim 16 A motion estimator for estimating motion in an electronic visual signal, comprising: a memory for storing a pattern of pixels in the signal; a second memory for storing the pattern of pixels in a comparison signal; logic means to derive a motion value =.SIGMA..vertline.P.sub.o -P.sub.a .vertline. where P.sub.o is the magnitude of a pixel in the pattern of the signal and P.sub.a is the magnitude of the pixel in the pattern of the comparison signal, characterised by multiplier means for applying weighted factors to the motion value dependent upon the position of the pixel in the pattern. ### Claim 17 (depends on 16) A motion estimator as claimed in claim 16, further comprising a store for storing a number of motion values and a best match logic coupled to the store for determining the minimum motion value. ### Claim 18 (depends on 16) A method of estimating motion using a motion estimator as claimed in claim 16, in which a motion value is derived for a number of patterns of pixels. ### Claim 19 (depends on 18) A method as claimed in claim 18, in which the patterns of pixels are offset from each other. ### Claim 20 (depends on 18) A method as claimed in claim 18 in which the weighted factors are varied to derive a number of motion values. ### Claim 21 (depends on 20) A method as claimed in claim 20, in which the number of motion values derived is limited by a prediction value.