Back to results
US 8,619,852 B2Granted
Systems and methods for multi-layered frame-compatible video delivery
AssigneeDolby Laboratories Licensing Corporation
InventorsAthanasios Leontaris, Alexandros Tourapis, Peshala V. Pahalawatta, Kevin Stec, Walter Husak
Life of this patent
Estimating the term…
Abstract
Multi-layered frame-compatible video delivery is described. Multi-layered encoding and decoding methods, comprising a base layer and at least one enhancement layer with reference processing, are provided. In addition, multi-layered encoding and decoding methods with inter-layer dependencies are described. Encoding and decoding methods that are capable of frame-compatible 3D video delivery are also described.
Claims23
An encoding method for multi-layered frame-compatible video delivery, comprising:
- a) base layer processing images or video frames of multiple views through a base layer, comprising:
- i) providing a base layer frame-compatible representation of the images or video frames of the multiple views;
- and
- b) enhancement layer processing the images or video frames of multiple views through one or more enhancement layers, comprising:
- i) providing an enhancement layer frame-compatible representation of the images or video frames of the multiple views;
- ii) maintaining at least one enhancement layer reference picture buffer;
- iii) reference processing at least one frame-compatible representation from the base layer or a different enhancement layer to produce a reference processed representation from the base layer or the different enhancement layer;
- and
- iv) performing motion or disparity compensation,
- wherein each of said one or more enhancement layer processes all the multiple views.
7 more elements
An encoding method for multi-layered frame-compatible video delivery, comprising:
- a) base layer processing images or video frames of multiple views through a base layer, comprising:
- i) providing a base layer frame-compatible representation of the images or video frames of the multiple views;
- and
- b) enhancement layer processing the images or video frames of multiple views through one or more enhancement layers, wherein each of the multiple views is processed separately in a separate enhancement layer, each of the one or more enhancement layers comprising:
- i) providing an enhancement layer representation of images or videos for one of the multiple views;
- ii) maintaining an enhancement layer reference picture buffer in each enhancement layer;
- iii) reference processing at least one frame-compatible representation from the base layer or at least one representation from a different enhancement layer;
- and
- iv) performing motion or disparity compensation.
6 more elements
A decoding method for multi-layered frame-compatible video delivery, comprising:
- a) base layer processing a plurality of base layer bitstream signals through a base layer, comprising:
- i) providing at least one frame-compatible base layer decode image or video frame;
- and
- b) enhancement layer processing a plurality of enhancement bitstream signals through one or more enhancement layers, comprising:
- i) providing at least one enhancement layer-decoded image or video frame for multiple views;
- ii) maintaining at least one enhancement layer reference picture buffer;
- iii) reference processing at least one frame-compatible base layer decode image or video frame from the base layer or at least one decoded image or video frame from a different enhancement layer;
- and
- iv) performing disparity compensation,
- wherein all the multiple views are decoded and processed in the same enhancement layer.
7 more elements
A decoding method for multi-layered frame-compatible video delivery, comprising:
- a) base layer processing a plurality of base layer bitstream signals through a base layer through a base layer, comprising:
- i) providing at least one frame-compatible base layer decode image or video frame;
- and
- b) enhancement layer processing a plurality of enhancement bitstream signals through one or more enhancement layers for multiple views through one or more enhancement layers, wherein each of the multiple views is processed separately in a separate enhancement layer, each of the one or more enhancement layers comprising:
- i) providing at least one enhancement layer-decoded image or video frame for one of the multiple views;
- ii) maintaining at least one enhancement layer reference picture buffer;
- iii) reference processing at least one frame-compatible decoded image or video frame from the base layer or at least one decoded image or video frame from a different enhancement layer;
- and
- iv) performing disparity compensation.
6 more elements
An encoding method for multi-layered frame-compatible video delivery, comprising:
- a) base layer processing images or video frames of multiple views through a base layer, comprising:
- i) providing a base layer frame-compatible representation of the images or video frames of the multiple views;
- and
- b) enhancement layer processing the images or video frames of multiple views through one or more enhancement layers, comprising:
- i) providing at least one enhancement layer representation of the images or video frames of the multiple views;
- ii) reference processing and de-multiplexing at least one frame-compatible representation from the base layer;
- iii) generating at least one enhancement layer residual by comparing the at least one enhancement layer representation of the images or video frames of the multiple views with the reference processed and de-multiplexed representation from the base layer;
- iv) processing the generated at least one enhancement layer residual to produce a first processed enhancement layer residual;
- v) maintaining at least one enhancement layer reference picture buffer;
- vi) processing at least one enhancement layer reference residual stored in the at least one enhancement layer reference picture buffer to produce a second processed enhancement layer residual;
- vii) performing motion or disparity compensation using the second processed enhancement layer residual, thus producing a motion or disparity compensated second processed enhancement layer residual;
- and
- viii) generating a further second processed enhancement layer residual by comparing the first processed enhancement layer residual with the motion or disparity compensated second processed enhancement layer residual.
10 more elements
A decoding method for multi-layered frame-compatible video delivery, comprising:
- a) base layer processing a plurality of base layer bitstream signals through a base layer, comprising:
- i) providing at least one frame-compatible base layer decode image or video frame;
- and
- b) enhancement layer processing a plurality of enhancement bitstream signals through one or more enhancement layers, comprising:
- i) providing at least one enhancement layer-decoded first residual for multiple views;
- ii) maintaining at least one enhancement layer reference picture buffer;
- iii) reference processing at least one frame-compatible base layer decode image or video frame from the base layer to produce at least one reference processed base layer decode image or video frame;
- iv) performing disparity compensation using at least one enhancement layer second residual from the at least one enhancement layer reference picture buffer, thus producing a motion or disparity compensated enhancement layer second residual;
- v) adding the at least one enhancement layer-decoded first residual to the motion or disparity compensated enhancement layer second residual and storing the result in the at least one enhancement layer reference picture buffer;
- and
- vi) adding the at least one reference processed base layer decode image or video frame to the at least one enhancement layer second residual from the at least one enhancement layer reference picture buffer to produce at least one enhancement layer output image.
8 more elements
Dependencies are inferred from the claim text.