US 8,525,883 B2Granted

Methods, systems and apparatus for automatic video quality assessment

AssigneeSharp Laboratories of America, Inc.

InventorsCuong Vu, Sachin G. Deshpande

Life of this patent

Estimating the term…

Loading patent…

Abstract

Aspects of the present invention are related to systems, methods and apparatus for automatic quality assessment of a video sequence. According to a first aspect of the present invention, a quality index may be generated by combining a spatial quality index and a temporal quality index. According to a second aspect of the present invention, a spatial quality index may be calculated using a modified exponential moving average model to pool multi-scale structural similarity indices computed from test frame—reference frame pairs. According to a third aspect of the present invention, a temporal quality index may be generated by averaging multi-scale structural similarity indices computed from difference image pairs, wherein one difference image is formed between reference frames and another difference image is formed between a reference frame and a test frame.

Claims19

Dependent claims

A method for determining a quality index for a test video sequence, said method comprising:

receiving, in a processor, a test video sequence, wherein said test video sequence comprises a first plurality of image values;
receiving, in said processor, a reference video sequence corresponding to said test video sequence, wherein said reference video sequence comprises a second plurality of image frames;
in said processor, calculating a spatial quality index using said test video sequence and said reference video sequence, wherein said calculating a spatial quality index comprises:
calculating a multi-scale structural similarity (MS-SSIM) index for each image frame in said first plurality of image frames and a temporally corresponding image frame in said second plurality of image frames, thereby producing a plurality of MS-SSIM indices;
pooling said plurality of MS-SSIM indices, thereby producing a plurality of pooled MS-SSIM indices;
determining a minimum value from said plurality of pooled MS-SSIM indices:
and
setting said spatial quality index to said minimum value;
in said processor, calculating a temporal quality index using said test video sequence and said reference video sequence;
and
in said processor, combining said spatial quality index and said temporal quality index to form a final quality index for said test video sequence.

8 more elements

A method for determining a quality index for a test video sequence, said method comprising:

receiving, in a processor, a test video sequence, wherein said test video sequence comprises a first plurality of image frames;
receiving, in said processor, a reference video sequence corresponding to said test video sequence, wherein said reference video sequence comprises a second plurality of image frames;
and
in said processor, calculating a spatial quality index using said test video sequence and said reference video sequence, wherein said calculating comprises:
calculating a multi-scale structural similarity (MS-SSIM) index for each image frame in said first plurality of image frames and a temporally corresponding image frame in said second plurality of image frames, thereby producing a plurality of MS-SSIM indices;
pooling said plurality of MS-SSIM indices, thereby producing a plurality of pooled MS-SSIM indices;
determining a minimum value from said plurality of pooled MS-SSIM indices;
and
setting said spatial quality index to said minimum value.

6 more elements

Dependencies are inferred from the claim text.