Back to results
US 12,574,557 B2Granted
Scalable video coding using base-layer hints for enhancement layer motion parameters
AssigneeDolby Video Compression, LLC
InventorsTobias Hinz, Haricharan Lakshman, Jan Stegemann, Philipp Helle, Mischa Siekmann, Karsten Suehring, Detlev Marpe, Heiko Schwarz, Christian Bartnik, Ali Atef Ibrahim Khairat Abdelhamid, Heiner Kirchhoffer, Thomas Wiegand
Life of this patent
Estimating the term…
Abstract
Information available from coding/decoding the base layer. i.e. base-layer hints, is exploited to render the motion-compensated prediction of the enhancement layer more efficient by more efficiently coding the enhancement layer motion parameters.
Claims11
A scalable video decoder comprising:
- a processor;
- and
- a predictive decoder configured to process, using the processor, information from a data stream to reconstruct an enhancement layer signal of a video based on block-wise predictive coding that includes:
- gathering, for a current block of a frame of the enhancement layer signal, a set of enhancement layer motion parameter candidates from already reconstructed neighboring blocks of the frame, the already reconstructed neighboring blocks neighboring the current block,
- gathering a set of one or more base layer motion parameters of a block of a base layer signal,
- enlarging the set of enhancement layer motion parameter candidates with one or more base layer motion parameters of the set of one or more base layer motion parameters or a scaled version thereof to obtain an extended motion parameter candidate set, each of the set of enhancement layer motion parameter candidates and the one or more base layer motion parameters or a scaled version thereof in the extended motion parameter candidate set is a separate element of the extended motion parameter candidate set, wherein the one or more base layer motion parameters are scaled according to a spatial resolution ratio between the base layer signal and the enhancement layer signal to acquire the scaled version of the one or more base layer motion parameters,
- extracting, from the data stream, identifying information indicating one of motion parameter candidates of the extended motion parameter candidate set to be selected for the current block,
- selecting the one of the motion parameter candidates of the extended motion parameter candidate set based on the identifying information,
- generating, by motion compensated prediction, a prediction of the current block of the enhancement layer signal using the selected one of the motion parameter candidates of the extended motion parameter candidate set, and
- reconstructing at least a portion of the enhancement layer signal based on the prediction of the current block and a residual signal.
7 more elements
A scalable video encoder comprising:
- a processor;
- and
- an encoder configured to encode into a data stream, using the processor, an enhancement layer signal of a video based on block-wise predictive coding that includes:
- gathering, for a current block of a frame of the enhancement layer signal, a set of enhancement layer motion parameter candidates from already reconstructed neighboring blocks of the frame, the already reconstructed neighboring blocks neighboring the current block,
- gathering a set of one or more base layer motion parameters of a block of a base layer signal,
- enlarging the set of enhancement layer motion parameter candidates with one or more base layer motion parameters of the set of one or more base layer motion parameters or a scaled version thereof to obtain an extended motion parameter candidate set, each of the set of enhancement layer motion parameter candidates and the one or more base layer motion parameters or a scaled version thereof in the extended motion parameter candidate set is a separate element of the extended motion parameter candidate set, wherein the one or more base layer motion parameters are scaled according to a spatial resolution ratio between the base layer signal and the enhancement layer signal to acquire the scaled version of the one or more base layer motion parameters,
- selecting one of motion parameter candidates of the extended motion parameter candidate set based on identifying information indicating the one of the motion parameter candidates of the extended motion parameter candidate set to be selected for the current block,
- generating, by motion compensated prediction, a prediction of the current block of the enhancement layer signal using the selected one of the motion parameter candidates of the extended motion parameter candidate set, and
- obtaining a residual signal for the current block based on a difference of the current block and the prediction of the current block, wherein the residual signal and a syntax element are encoded into the data stream.
6 more elements
A non-transitory computer-readable medium for storing data associated with a video, comprising:
- a data stream stored in the non-transitory computer-readable medium, the data stream comprising encoded information associated with an array of information samples representing a spatially sampled portion of a video, the encoded information including a residual signal and a syntax element, wherein the data stream is obtained based on a plurality of operations including:
- encoding an enhancement layer signal of a video based on block-wise predictive coding that includes:
- gathering, for a current block of a frame of the enhancement layer signal, a set of enhancement layer motion parameter candidates from already reconstructed neighboring blocks of the frame, the already reconstructed neighboring blocks neighboring the current block,
- gathering a set of one or more base layer motion parameters of a block of a base layer signal,
- enlarging the set of enhancement layer motion parameter candidates with one or more base layer motion parameters of the set of one or more base layer motion parameters or a scaled version thereof to obtain an extended motion parameter candidate set, each of the set of enhancement layer motion parameter candidates and the one or more base layer motion parameters or a scaled version thereof in the extended motion parameter candidate set is a separate element of the extended motion parameter candidate set, wherein the one or more base layer motion parameters are scaled according to a spatial resolution ratio between the base layer signal and the enhancement layer signal to acquire the scaled version of the one or more base layer motion parameters,
- selecting one of motion parameter candidates of the extended motion parameter candidate set based on identifying information indicating the one of the motion parameter candidates of the extended motion parameter candidate set to be selected for the current block,
- generating, by motion compensated prediction, a prediction of the current block of the enhancement layer signal using the selected one of the motion parameter candidates of the extended motion parameter candidate set, and
- obtaining the residual signal for the current block based on a difference of the current block and the prediction of the current block, wherein the residual signal and a syntax element are encoded into the data stream.
5 more elements
Dependencies are inferred from the claim text.