System and method for encoding and decoding the residual signal for fine granular scalable video

For use in a video encoder comprising 1) base layer circuitry capable of receiving an input stream of video frames and generating therefrom compressed base layer video data suitable for transmission to a streaming video receiver and 2) enhancement layer circuitry capable of generating therefrom enhancement layer video data associated with the compressed base layer video data and suitable for transmission to the streaming video receiver, a method of operating the video encoder comprising the steps of:

• generating a plurality of original transform coefficients (O) associated with the input stream of video frames;
• generating a plurality of reconstructed base layer transform coefficients (B) by quantizing and de-quantizing the plurality of original transform coefficients;
• generating from the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B) a residual signal (R) proportional to a difference between the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B);
• and
• encoding and sending a sign of the residual signal to the streaming video receiver.

For use in a video decoder comprising 1) base layer circuitry capable of receiving compressed base layer video data, and 2) enhancement layer circuitry capable of receiving enhancement layer video data associated with the compressed base layer video data, a method of operating the video decoder comprising the steps of:

• determining from the compressed base layer video data a plurality of reconstructed base layers transform coefficients (B) associated with a quantization of the compressed base layer video data;
• and
• determining from the enhancement layer video data a residual signal (R) and a sign associated with the residual signal (R);
• and
• reconstructing a plurality of enhancement layer transform coefficients (E) from the residual signal (R) and the plurality of reconstructed base layer transform coefficients (B).

A television receiver comprising:

• a decoder buffer capable of receiving and storing compressed base layer video data and compressed enhancement layer video data;
• and
• a video decoder coupled to said decoder buffer comprising:
• base layer circuitry capable of receiving said compressed base layer video data and determining therefrom a plurality of reconstructed base layer transform coefficients (B) associated with a quantization of said compressed base layer video data;
• and
• enhancement layer circuitry capable of receiving said compressed enhancement layer video data associated with said compressed base layer video data and determining therefrom a residual signal (R) and a sign associated with said residual signal (R), wherein said enhancement layer circuitry is further capable of reconstructing a plurality of enhancement layer transform coefficients (E) from said residual signal (R) and said plurality of reconstructed base layer transform coefficients (B).

For use in a video processing system capable of receiving compressed base layer video data and enhancement layer video data associated with the compressed base layer video data, computer-executable process steps stored on a computer-readable storage medium for decoding the enhancement layer video data, the computer executable process steps comprising the steps of:

• determining from the compressed base layer video data a plurality of reconstructed base layer transform coefficients (B) associated with a quantization of the compressed base layer video data;
• and
• determining from the enhancement layer video data a residual signal (R) and a sign associated with the residual signal (R);
• and
• reconstructing a plurality of enhancement layer transform coefficients (E) from the residual signal (R) and the plurality of reconstructed base layer transform coefficients (B).

A video system comprising:

• a television receiver comprising:
• a decoder buffer capable of receiving and storing compressed base layer video data and compressed enhancement layer video data;
• and
• a video decoder coupled to said decoder buffer comprising:
• base layer circuitry capable of receiving said compressed base layer video data and determining therefrom a plurality of reconstructed base layer transform coefficients (B) associated with a quantization of said compressed base layer video data;
• and
• enhancement layer circuitry capable of receiving compressed enhancement layer video data associated with said compressed base layer video data and determining therefrom a residual signal (R) and a sign associated with said residual signal (R), wherein said enhancement layer circuitry is further capable of reconstructing a plurality of enhancement layer transform coefficients (E) from said residual signal (R) and said plurality of reconstructed base layer transform coefficients (B);
• and
• a video display coupled to said television receiver for displaying video images derived from said base layer video data and said enhancement layer video data containing said inserted all-zero bit plane.

A transmittable enhancement layer video signal produced by the steps of:

• receiving in base layer circuitry of a video encoder an input stream of video frames and generating therefrom compressed base layer video data suitable for transmission to a streaming video receiver;
• generating a plurality of original transform coefficients (O) associated with the input stream of video frames;
• generating a plurality of reconstructed base layer transform coefficients (B) associated with the plurality of original transform coefficients (O);
• generating from the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B) a residual signal (R) proportional to a difference between the plurality of original transform coefficients (O) and the plurality of reconstructed base layer transform coefficients (B);
• and
• encoding a sign of the residual signal and encoding the residual signal to thereby create the transmittable enhancement layer video signal.

A network system comprising:

• at least one streaming video receiver;
• a streaming video transmitter comprising:
• video encoder comprising:
• base layer circuitry capable of receiving an input stream of video frames and generating therefrom compressed base layer video data suitable for transmission to said at least one streaming video receiver, said base layer video data comprising a plurality of original transform coefficients (O) associated with said input stream of video frames and a plurality of reconstructed base layer transform coefficients (B) associated with said plurality of original transform coefficients;
• and
• enhancement layer circuitry capable of receiving said plurality of original transform coefficients (O) and said plurality of reconstructed base layer transform coefficients (B) and generating therefrom a residual signal (R) proportional to a difference between said plurality of original transform coefficients (O) and said plurality of reconstructed base layer transform coefficients (B), wherein said enhancement layer circuitry encodes and sends a sign of said residual signal (R) to said at least one streaming video receiver;
• and
• a variable bandwidth network capable of transporting said base layer video data and said enhancement layer video data from said streaming video transmitter to said at least one streaming video receiver.