Spatially adaptive video coding
AssigneeMicrosoft Corporation
InventorsDavid Zhao, Sergey Nikiforov, Konrad Hofbauer, Magnus Hemmendorff, Pontus Carlsson
Life of this patent
Estimating the term…
Abstract
A video signal comprises a sequence of source frames to be encoded. A pre-processing stage determines a region of interest for a plurality of the source frames, and spatially adapts each of the plurality of the source frames to produce a respective warped frame. In the respective warped frame, the region of interest comprises a higher spatial proportion of the warped frame than in the source frame. The pre-processing stage supplies the warped frames to an encoder to be encoded into an encoded version of the video signal.
Claims20
Apparatus for encoding a video signal comprising a sequence of source frames, the apparatus comprising:
- an encoder;
- and
- a pre-processing stage configured to determine a region of interest for a plurality of the source frames, and to spatially adapt each of the plurality of the source frames to produce a respective warped frame in which the region of interest comprises a higher spatial proportion of the warped frame than in the source frame;
- wherein the pre-processing stage is arranged is to supply the warped frames to the encoder to be encoded into an encoded version of the video signal.
Apparatus for decoding a video signal, the apparatus comprising:
- a decoder arranged to decode the video signal to produce a plurality of warped frames, each having been spatially adapted from a respective source frame so that a region of interest comprises a higher spatial proportion of the warped frame than in the source frame;
- and
- a post-processing stage configured to reverse said spatial adaptation to output decoded versions of the source frames.
A computer program product for encoding a video signal comprising a sequence of source frames, the computer program product comprising code embodied on a computer-readable medium and configured to as when executed on a transmitting terminal to perform operations of:
- determining a region of interest for a plurality of the source frames, the region of interest comprising at least part of a face of a user of the transmitting terminal;
- applying pre-processing to spatially adapt each of the plurality of the source frames to produce a respective warped frame in which the region of interest comprises a higher spatial proportion of the warped frame than in the source frame;
- encoding the warped frames to produce an encoded version of the video signal;
- transmitting the encoded video signal to a receiving terminal over a packet-based network, as part of a live video call.
Dependencies are inferred from the claim text.