System and method for rate-distortion optimized data partitioning for video coding using backward adaptation
AssigneeKoninklijke Philips Electronics N.V.
InventorsJong Chul Ye, Yingwei Chen
Life of this patent
Estimating the term…
Abstract
A system and method are disclosed that provide a simple and efficient layered video coding technique using a backward adaptive rate-distortion optimized data partitioning (RD-DP) of DCT coefficients. The video coding system may include an rate-distortion optimized data partitioning encoder and decoder. The RD-DP encoder adapts the partition point block-by-block which greatly improves the coding efficiency of the base layer bit stream without explicit transmission thereby saving the bandwidth significantly. The RD-DP decoder can also find the partition location in backward-fashion from the decoded data.
Claims29
A data partitioning method for a scalable video encoder, the comprising the steps of:
- receiving video data;
- determining DCT coefficients for a plurality of macroblocks of a video frame;
- quantizing the DCT coefficients;
- converting the quantized DCT coefficients into (run, length) pairs;
- and for each the plurality of macroblocks in the video frame, determining a ratio |Xik|2/Li2, where a k-th (run, length) pair for an i-th block is Lik bits and has a coefficient value of Xik;
- and if a k-th ratio for the k-th (run, length) pair is less than λ or if the k-th ratio is a first ratio that is not less than λ, putting the k-th (run, length) pair into a base layer, otherwise if the k-th ratio for the k-th (run, length) pair is greater than λ, putting the k-th (run, length) pair into an enhancement layer, where λ is determined in accordance with a Lagrangian calculation.
A method for determining a boundary between a base layer and at least one enhancement layer in a scalable video decoder, the comprising the steps of:
- receiving the base layer and the at least one enhancement layer, the base layer and enhancement layer including data representing (run, length) pairs for a plurality of macroblocks in a video frame;
- for each the plurality of macroblocks in the video frame, determining a ratio |Xik|2/Li2, where a k-th (run, length) pair for an i-th block is Lik, bits and has a coefficient value of Xik;
- and if the ratio for the k-th (run, length) pair is less than .lambda. or if the k-th ratio is a first ratio that is not less than λ, read the k-th (run, length) pair from the base layer, otherwise if the ratio for the k-th (run, length) pair is greater than λ, read the k-th (run, length) pair from the at least one enhancement layer, where λ is determined by decoding side information.
A scalable decoder capable of merging data from a base layer and at least one enhancement layer, the apparatus comprising:
- a memory which stores computer-executable process steps;
- and a processor which executes the process steps stored in the memory so as (i) receiving the base layer and the at least one enhancement layer, the base layer and enhancement layer including data representing (run, length) pairs for a plurality of macroblocks in a video frame, and (2) for each the plurality of macroblocks in the video frame, determining a ratio |Xik|2/Li2, where a k-th (run, length) pair for an i-th block is Lik bits and has a coefficient value of Xik, and (3) if the ratio for the k-th (run, length) pair is less than λ or if the k-th ratio is a first ratio that is not less than λ, read the k-th (run, length) pair from the base layer, otherwise if the ratio for the k-th (run, length) pair is greater than λ, read the k-th (run, length) pair from the at least one enhancement layer, where λ is determined in accordance with a Lagrangian calculation.
Dependencies are inferred from the claim text.