US 10,708,624 B1 · Pre-processing for video compression

Abstract

A processing system filters blocks of a picture to minimize a size and error of the blocks prior to encoding. A pre-processing module of the processing system measures characteristics of a plurality of blocks and evaluates the effects of applying each of a plurality of filters to the blocks prior to encoding in order to predict an increase in compressibility of blocks having similar characteristics that are filtered with each filter before being encoded, with the least impact on quality. The pre-processing module trains models to predict a size and error of blocks filtered with each filter based on block characteristics. The pre-processing module uses the models to calculate a cost in terms of size and error of applying each filter to a given block having certain characteristics. The pre-processing module then applies to the block the filter that is predicted to result in the best cost.

Claims20

Dependent claims

A method comprising:

characterizing each block of a plurality of blocks of one or more pictures based on metrics comprising at least one of spatial gradient, colorfulness, contrast, or noisiness;
applying a first filter to filter each block of the plurality of blocks;
encoding each of the plurality of blocks filtered with the first filter using a first quantization parameter;
calculating a size and an error of each of the plurality of blocks encoded and filtered with the first filter;
predicting a size and an error of a first block of a first picture based on a characterization of the first block and the characterizations and the sizes and errors of each of the plurality of blocks, wherein the first block is filtered with the first filter and encoded using the first quantization parameter;
and
applying the first filter to the first block in response to a cost of the first filter, based on the predicted size and error, being below a threshold.

4 more elements

A method, comprising:

calculating a cost of applying a first filter and a cost of applying a second filter different from the first filter to a first block of a picture, wherein the cost of the first filter is based on a characterization based on metrics comprising at least one of spatial gradient, colorfulness, contrast, or noisiness, first predicted size and first predicted error for the first block, wherein the first block is filtered using the first filter and encoded using a first quantization parameter, and the cost of the second filter is based on the characterization, second size and second error for the first block, wherein the first block is filtered using the second filter and encoded using the first quantization parameter;
selecting the first filter or the second filter, based on the cost of the first filter and the cost of the second filter;
applying the selected filter to filter the first block;
and
providing the filtered first block to an encoder for encoding the filtered first block.

2 more elements

A device, comprising:

a cost calculator to estimate of applying a first filter and a cost of applying a second filter different from the first filter to a first block of a picture, wherein the cost of the first filter is based on a characterization of the first block based on metrics comprising at least one of spatial gradient, colorfulness, contrast, or noisiness and a first predicted size and a first predicted error for the first block, wherein the first block is filtered using the first filter and encoded using a first quantization parameter, and the cost of the second filter is based on the characterization of the first block and a second size and a second error for the first block, wherein the first block is filtered using the second filter and encoded using the first quantization parameter;
a filter selector to select the first filter or the second filter, based on the cost of the first filter and the cost of the second filter, and apply the selected filter to filter the first block;
and
an encoder to encode the filtered first block.

1 more element

Dependencies are inferred from the claim text.

Pre-processing for video compression

Life of this patent

Pre-processing for video compression

Life of this patent

Abstract

Claims20