Video coding and adaptation by semantics-driven resolution control for transport and storage
OwnerM. Civanlar, A. Tekalpinventors
Life of this patent
Estimating the term…
Abstract
A method and system for modifying the spatial and/or temporal resolution and/or signal to noise ratio of temporal and/or spatial segments of compressed video based on semantic properties of the video content to adapt the compressed video size for transport and storage applications.
Claims18
A method to select optimum spatial resolution (frame size), temporal resolution (frame rate) and SNR (quantization parameter) for encoding each of a plurality of spatio-temporal segments of input video, said method comprising:
- classifying each of said plurality of spatio-temporal segments according to content types, and
- determining the optimum spatial resolution, temporal resolution, and SNR simultaneously for encoding each spatio-temporal segment based on said content types and one or more optimization criteria.
A method to select optimum encoding parameters, said encoding parameters comprising, spatial resolution (frame size), temporal resolution (frame rate) and SNR (quantization parameter), using a non-scalable encoder, said method comprising:
- dividing input video into a plurality of spatio-temporal segments;
- classifying each of said plurality of segments according to content types;
- selecting optimum encoding parameters for each of said classified plurality of segments to optimize one or more optimization criteria, and
- encoding each of said classified plurality of segments with said optimal encoding parameters.
A method to select optimum scalability parameters, said scalability parameters comprising, spatial resolution (frame size), temporal resolution (frame rate) and SNR (quantization parameter), using a scalable video encoder, said method comprising:
- dividing input video into a plurality of segments;
- classifying each of said plurality of segments according to content types;
- encoding each of said plurality of segments with a scalable encoder;
- selecting optimum scalability parameters for each of said classified plurality of segments to optimize one or more optimization criteria, and
- extracting a bitstream according to the said optimum scalability parameters.
A system to select optimum encoding parameters, said encoding parameters comprising, spatial resolution (frame size), temporal resolution (frame rate) and SNR (quantization parameter), using a non-scalable encoder, said system comprising:
- a content analysis component receiving video as input, dividing said video into a plurality of segments and classifying each of said plurality of segments according to content types, and
- a content adaptive video encoder component processing said plurality of segments simultaneously or one at a time by selecting optimum encoding parameters for each of said classified plurality of segments to optimize one or more optimization criteria.
A system to select optimum encoding parameters, said encoding parameters comprising, spatial resolution (frame size), temporal resolution (frame rate) and SNR (quantization parameter), using a non-scalable encoder, said system comprising:
- a content analysis component receiving video as input, dividing said video into a plurality of segments and classifying each of said plurality of segments according to content types;
- a pre-processor component converting each of said plurality of segments into a set of pre-selected spatial and temporal resolution format choices;
- a content adaptive non-scalable encoder encoding each of said classified plurality of segments with said optimal encoding parameters, said encoder comprising;
- a standard encoder encoding each of said pre-selected spatial and temporal resolution format choices of said plurality of segments with encoding parameter sets and outputting a bitstream with rate-distortion pairs for each of said pre-selected spatial and temporal resolution format choices of said segments, and
- a multiple objective optimization component selecting said optimum encoding parameters based on said rate-distortion pairs for each of said classified plurality of segments along with user-defined relevancy levels and available channel bandwidth information to optimize one or more optimization criteria.
A system to select optimum encoding parameters, said encoding parameters comprising, spatial resolution (frame size), temporal resolution (frame rate) and SNR (quantization parameter), using a scalable encoder, said system comprising:
- a content analysis component receiving video as input, dividing said video into a plurality of segments and classifying each of said plurality of segments according to content types;
- a scalable encoder encoding each of said plurality of segements with said optimum encoding parameters with respect to a distortion metric;
- a decoder decoding bitstreams formed by different combinations of said encoding parameters for each of said plurality of segements;
- a selection component evaluating a cost function for each of said combinations and selecting optimum encoding parameters that minimize said cost function to optimize one or more optimization criteria, and
- an extraction component extracting a bitstream according to the said optimum encoding parameters.
Dependencies are inferred from the claim text.