Method and apparatus for video signal encoding with motion compensation
AssigneeBell Telephone Laboratories, Incorporated
InventorsArun N. Netravali, John D. Robbins
Life of this patent
Estimating the term…
Abstract
Method and apparatus for encoding a video signal wherein the prediction errors for previously encoded pels are evaluated using motion compensation and frame difference predictions. Each present pel intensity value is then predicted using the technique which produced the smaller prediction error sum. Prediction errors for the present pel are encoded, together with address information, if the error exceeds a threshold value. The motion compensated prediction utilizes a displacement estimate which is recursively updated. A decoder is also described.
Claims18
Apparatus for encoding a video signal including a plurality of samples each representing the intensity of an element of a picture, including:
- means (220) for estimating the displacement of objects in said picture which occur between the present frame and a previous frame;
- first means (210, 226) for predicting the intensities of a set of previously processed ones of said pels based upon the intensities at displaced locations in said previous frame determined by said estimates;
- second means (210, 213) for predicting the intensities of said first set of pels based upon the intensities of the spatially corresponding locations in said previous frame;
- means (250) for computing first and second sums of the prediction errors associated with predictions made by said first and second means using displaced frame difference and frame difference techniques, respectively;
- and
- means (240) responsive to said computing means for predicting the intensity value of the present pel using the one of said prediction techniques which has the smaller prediction error sum.
Apparatus for encoding a series of samples each representing the intensity of an element of a picture, comprising:
- means for predicting the intensity values of a set of previously encoded pels using first and second predictors;
- means for selecting as the predicted value of the presently processed pel the value derived from the one of said first and second predictors for which the sum of prediction errors for said previously encoded set of pels is smallest;
- and
- means for encoding (a) the prediction error of unpredictable pels for which the prediction error for said presently processed pel exceeds a threshold, and (b) the locations of said unpredictable pels.
Apparatus for encoding a video signal which includes a plurality of samples each representing the intensity of a particular element of a picture comprising:
- means (220) for forming an estimate of the displacement of objects in said picture between a present frame and a prior frame;
- means (226, 210, 213, 211) for forming first and second predictions of the intensities of a series of pels in said present frame based upon (a) corresponding locations in said prior frame, and (b) displaced locations in said previous frame determined by said displacement estimates:
- means (250) for selecting a predicted value for the present pel based upon the relative magnitudes of the prediction errors of said first and second prediction means for comparing the prediction error associated with said selected predicted value to a threshold;
- and
- means (206) for encoding the location and prediction error of pels for which said prediction error exceeds said threshold.
A method of encoding a series of samples each representing the intensity of an element of a picture, comprising the steps of:
- predicting the intensity values of a set of previously encoded pels using first and second predictors;
- selecting as the predicted value of the presently processed pel the value derived from the one of said first and second predictors for which the sum of prediction errors for said previously encoded set of pels is smaller;
- and
- encoding (a) the prediction error of unpredictable pels for which the prediction error for said presently processed pel exceeds a threshold, and (b) the locations of said unpredictable pels.
Apparatus for encoding a video signal including a plurality of samples each representing the intensity of an element of a picture, including:
- means (220) for estimating the displacement D of objects in said picture which occur between the present frame at time t and a previous frame at time t-.tau.;
- first means (226) for predicting the intensities I(x.sub.A,t), I(x.sub.B,t), I(x.sub.C,t) . . . of a set A, B, C . . . of said pels at locations x.sub.A, x.sub.B, x.sub.C . . . based upon the intensities I(x.sub.A -D,t-.tau.), I(x.sub.B -D,t-.tau.), I(x.sub.C -D,t-.tau.) . . . at displaced locations x.sub.A -D, x.sub.B -D, x.sub.C -D . . . in said previous frame determined by said estimates;
- second means (210, 213) for predicting the intensities of said first set of pels based upon the intensities I(x.sub.A,t-.tau.), I(x.sub.B,t-.tau.), I(x.sub.C,t-.tau.) . . . of the spatially corresponding locations x.sub.A, x.sub.B, x.sub.C . . . in said previous frame;
- means (250) for computing first and second sums of the prediction errors associated with predictions made by said first and second means, respectively;
- and
- means (240, 206) responsive to said computing means for encoding the error value .epsilon. representing the difference between the present sample of said signal which represents the intensity value I(x.sub.Z,t) at location x.sub.Z and a predicted version P.sub.Z thereof, wherein P.sub.Z is predicted based upon the intensity I(x.sub.Z,t-.tau.) of the spatially corresponding location x.sub.Z in the previous frame or the intensity I(x.sub.Z -D,t-.tau.) of the displaced location x.sub.Z -D in said previous frame, depending upon which of said first and second sums is smaller.
Dependencies are inferred from the claim text.