Back to results
US 9,313,526 B2Granted
Data compression for video
AssigneeSkype
InventorsLazar Bivolarsky, Renat Vafin, Mattias Nilsson, Soren Vang Andersen
Life of this patent
Estimating the term…
Abstract
The present invention provides a technique for performing one or more aspects of video coding such as quantization, intra prediction coding or inter prediction coding in dependence on a perceptual model taking into account human sensitivity to data in the video signal. The perceptual model may relate to spatial frequency, temporal frequency, contrast sensitivity, color sensitivity, a structural metric, and/or one or more parameters affecting perception such as motion in the video, the distance of a recipient user from the screen, and the size, aspect ratio or resolution of the screen of the recipient terminal.
Claims46
A method comprising:
- receiving a video signal comprising a plurality of frames, each frame comprising one or more portions of video data;
- transforming each of said portions into a transform domain, so as for each portion to generate transformed video data comprising a set of coefficients, each coefficient representing a contribution to a property of the portion at a different spatial or temporal frequency;
- quantizing the video data of each portion according to a quantization bin size distribution, the quantization bin size distribution varying dynamically during ongoing encoding such that a different quantization bin size distribution is applied to different transformed video data, the quantization bin size distribution being dependent on:
- a structural metric of the one or more portions of the video data and a measure of human sensitivity to the video data such that a portion of the video data to which a human viewer is more sensitive is quantized using a smaller quantization bin size and a portion of the video data to which the human viewer is less sensitive is quantized using a larger quantization bin size, the quantization bin size distribution varying dynamically according to information received automatically from a recipient terminal;
- and
- encoding the video data of each portion based, at least in part, on the quantizing.
3 more elements
A method comprising:
- receiving a video signal comprising a plurality of frames, each frame comprising one or more portions of video data;
- transforming each of said portions into a transform domain, so as for each portion to generate transformed video data comprising a set of coefficients, each coefficient representing a contribution to a property of the portion at a different spatial or temporal frequency;
- quantizing the video data of each portion, the quantizing including quantizing the coefficients of each portion;
- encoding the video data of each portion according to a quantization bin size distribution, the quantization bin size distribution varying dynamically during ongoing encoding such that a different quantization bin size distribution is applied to different transformed video data, the quantization bin size distribution being dependent on:
- a measure of human sensitivity to the video data such that a portion of the video data to which a human viewer is more sensitive is quantized using a smaller quantization bin size and a portion of the video data to which the human viewer is less sensitive is quantized using a larger quantization bin size, the encoding including using different quantization bin size distributions for different colour channels;
- and
- transmitting the encoded bitstream to a decoder, the encoded bitstream including side information indicating a prediction method to be used during decoding, the prediction method being dependent on the measure of human sensitivity to the video data.
4 more elements
An encoder comprising:
- a signal processing apparatus configured to implement a method of encoding a video signal for transmission to a decoder of a receiving terminal, the method comprising:
- receiving a video signal comprising a plurality of frames, each frame comprising one or more portions of video data;
- transforming each of said portions into a transform domain, so as for each portion to generate transformed video data comprising a set of coefficients, each coefficient representing a contribution to a property of the portion at a different spatial or temporal frequency;
- quantizing the video data of each portion according to a quantization bin size distribution, the quantizing including quantizing the coefficients of each portion, the quantization bin size distribution varying dynamically during ongoing encoding such that a different quantization bin size distribution is applied to different transformed video data, the quantization bin size distribution being dependent on:
- a structural metric of the one or more portions of the video data and a measure of human sensitivity to the video data such that a portion of the video data to which a human viewer is more sensitive is quantized using a smaller quantization bin size and a portion of the video data to which the human viewer is less sensitive is quantized using a larger quantization bin size, the quantization bin size distribution varying dynamically during ongoing encoding in dependence on information received automatically from a recipient terminal;
- encoding the video data of each portion based, at least in part, on the quantizing.
3 more elements
An encoder comprising:
- a signal processing apparatus configured to implement a method of encoding a video signal for transmission to a decoder of a receiving terminal, the method comprising:
- receiving a video signal comprising a plurality of frames, each frame comprising one or more portions of video data;
- transforming each of said portions into a transform domain, so as for each portion to generate transformed video data comprising a set of coefficients, each coefficient representing a contribution to a property of the portion at a different spatial or temporal frequency,
- quantizing the video data of each portion, the quantizing including quantizing the coefficients of each portion;
- and
- encoding the video data of each portion according to a quantization bin size distribution, the quantization bin size distribution varying dynamically during ongoing encoding such that a different quantization bin size distribution is applied to different transformed video data, the quantization bin size distribution being dependent on:
- a structural metric of the one or more portions of the video data and a measure of human sensitivity to the video data such that a portion of the video data to which a human viewer is more sensitive is quantized using a smaller quantization bin size and a portion of the video data to which the human viewer is less sensitive is quantized using a larger quantization bin size, the quantization bin size distribution varying dynamically according to information received automatically from a recipient terminal.
4 more elements
Dependencies are inferred from the claim text.