US 8,798,140 B2Granted

Encoding video frames in a video encoder

AssigneeNVIDIA Corporation

InventorsMandar Anil Potdar, Soumen Kumar Dey

Life of this patent

Estimating the term…

Loading patent…

Abstract

An encoder provided according to an aspect of the present invention uses an approach which seeks to limit the number of bits in each of a sequence of video frames to a same upper limit. By providing such a restriction, additional budget (i.e., more number of bits that can be used for the encoded bits for the frame) may be available for encoding of later received frames in the sequence, thereby avoiding quality degradation with respect to reproduction of such later frames. According to another aspect of the present invention, a quantization parameter used during encoding is controlled to enforce such a limit. According to one more aspect of the present invention, a quantization parameter is generated for a video frame by examining content corresponding to the same video frame.

Claims7

Dependent claims

A method of processing video frames in an encoding system, said method comprising:

receiving a sequence of video frames, wherein each of said sequence of frames comprises a corresponding sequence of pixel values;
and
encoding each of said sequence of frames according to limiting a number of bits of each encoded frame to a pre-specified upper limit for each encoded frame, wherein each of said sequence of frames is encoded using a respective quantization parameter based on said pre-specified upper limit;
receiving an average bit rate, wherein said average bit rate represents an average number of bits per unit time formed by said encoding in a duration, wherein said pre-specified upper limit is computed based on said average bit rate,
wherein said encoding comprises:
generating a sequence of difference frames by comparing each of said sequence of video frames with a corresponding reference frame;
applying a transform on each of said sequence of difference frames to generate a corresponding set of coefficients;
determining a quantization parameter for each of said sequence of frames based on said pre-specified upper limit, wherein said determining comprises:
examining each video frame to determine a corresponding complexity, wherein a number of bits required to represent the video frame for a same quality is proportionate to said complexity, wherein said examining comprises calculating an average of variances of macroblocks contained in each present frame, wherein a maximum target bits (MTB) per macroblock is calculated in the present frame, and wherein said MTB and said average of variances are used to set said quantization parameter for the present frame;
and
setting said quantization parameter for each frame to have a positive correlation with said complexity, wherein said quantization parameter is determined based on said upper limit;
quantizing said set of coefficients according to said quantization parameter to generate a set of quantized coefficients;
and
coding said set of quantized coefficients to form a set of code words, which together represents the set of pixel values for the corresponding video frame;
and
maintaining a plurality of tables, one for each of non-overlapping ranges of MTB values, wherein each table indicates a corresponding quantization parameter for said average of variances, wherein said using includes performing a lookup of said plurality of tables.

13 more elements

A machine readable storage medium storing one or more sequences of instructions for causing a video encoding system to process video frames, wherein execution of said one or more sequences of instructions by one or more processors contained in said system causes said system to perform the actions of:

forming a sequence of difference frames representing a sequence of video frames;
transforming said sequence of difference frames to a corresponding sequence of sets of coefficients, each set corresponding to a difference frame;
quantizing each of said sequence of sets of coefficients using a corresponding one of a sequence of quantization parameters to form a sequence of sets of quantized coefficients;
coding said sequence of sets of quantized coefficients to form a sequence of encoded frames representing said sequence of video frames;
generating a sequence of quantization parameters, each for a corresponding difference frame, wherein each quantization parameter is set to limit the size of each of said encoded frames to an upper limit, wherein said generating comprises:
examining each video frame to determine a corresponding complexity, wherein a number of bits required to represent the video frame for a same quality is proportionate to said complexity, wherein said examining comprises calculating an average of variances of macroblocks contained in each present frame;
and
setting said quantization parameter for each frame to have a positive correlation with said complexity, wherein said quantization parameter is determined based on said upper limit;
receiving an average bit rate, wherein said average bit rate represents an average number of bits per unit time formed by said encoding in a duration, wherein said pre-specified upper limit is computed based on said average bit rate;
computing a maximum target bits (MTB) per macroblock in the present frame;
maintaining a plurality of tables, one for each of non-overlapping ranges of MTB values, wherein each table indicates a corresponding quantization parameter for said average of variances;
and
using said MTB and said average of variances to set said quantization parameter for the present frame, wherein said using comprises performing a lookup of said plurality of tables.

10 more elements

Dependencies are inferred from the claim text.

Facts

Application: 12/360,120Filed 27 Jan 2009
Published: US 2010/0189174 A129 Jul 2010
Granted: 5 Aug 2014
Term ends: Not estimatedThe source records don’t support an estimate.

Classification8 codes

H04N 19/179
Characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the…: the…
H04N 19/115
Characterised by the element, parameter or selection affected or controlled by the adaptive coding: selection of the code volume for a coding unit…
H04N 19/124
Characterised by the element, parameter or selection affected or controlled by the adaptive coding: quantisation
H04N 19/14
Incoming video signal characteristics or properties: coding unit complexity, e.g. amount of activity or edge presence estimation