# US 2022/0044385 A1 · Methods of video quality assessment using parametric and pixel level models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044385 A1
- Document ID: US20220044385A1
- Status: Published application
- Kind: A1
- Application number: 17/362,145
- Filed: 2021-06-29
- Published: 2022-02-10
- Earliest claimed: 2020-08-10
- Assignees: Tencent America LLC
- Applicants: Tencent America LLC
- Inventors: Xiaozhong XU; Xiang LI; Shan LIU
- Web page: https://patentgrep.com/patent/US20220044385A1

## CPC

- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence)
- H04N 19/154: Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147)
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30168: Image quality inspection
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method, apparatus and storage medium for performing a video quality assessment (VQA) are provided. The method includes obtaining a plurality of images of a video, the plurality of images being divided into one or more groups; determining first images among the plurality of images to which a parametric-based VQA is to be applied, the first images being all of the plurality of images; determining a first score based on applying the parametric-based VQA to each of the first images; determining second images among the plurality of images to which a sample-based VQA is to be applied; determining a second score based on applying the sample-based VQA to each of the second images; and outputting a final score for at least one image based on the first score and the second score.

## Claims

### Claim 1

A method of performing a video quality assessment (VQA), the method comprising:
obtaining a plurality of images of a video, the plurality of images being divided into one or more groups;
determining first images among the plurality of images to which a parametric-based VQA is to be applied, the first images being all of the plurality of images;
determining a first score based on applying the parametric-based VQA to each of the first images;
determining second images among the plurality of images to which a sample-based VQA is to be applied;
determining a second score based on applying the sample-based VQA to each of the second images; and
outputting a final score for at least one image based on the first score and the second score.

### Claim 2 (depends on 1)

The method of claim 1, wherein the determining the second images comprises: selecting at least one image in each of the one or more groups.

### Claim 3 (depends on 1)

The method of claim 1, wherein the determining the second images comprises: selecting images among the plurality of images at a predetermined time interval or a predetermined frame interval.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
based on determining that the second score is not available for at least one of the first images, calibrating the first score.

### Claim 5 (depends on 4)

The method of claim 4, wherein the calibrating the first score comprises:
obtaining one or more first images prior to the at least one of the first images in a sequence in decoding order;
obtaining one or more second images corresponding to the one or more first images;
calculating a difference between a first scoring system of the parametric-based VQA and a second scoring system of the sample-based VQA based on the first score of the one or more first images and the second score of the one or more second images; and
calibrating the first score based on the difference between the first scoring system and the second scoring system.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
receiving information about complexity of the video; and
adjusting the first score based on the information about complexity of the video.

### Claim 7 (depends on 6)

The method of claim 6, wherein the information about complexity of the video comprises at least one from among a spatial textual information of the video, a temporal motion information of the video and a resolution of the video.

### Claim 8 (depends on 6)

The method of claim 6, wherein the information about complexity of the video is included in at least one from among metadata and shutter interval information (SEI) message.

### Claim 9 (depends on 1)

The method of claim 1, wherein at least one first image from among the first images and at least one second image from among the second images are the same.

### Claim 10

An apparatus for performing a video quality assessment (VQA) comprising:
at least one memory storing computer program code; and
at least one processor configured to access the at least one memory and operate as instructed by the computer program code, the computer program code comprising:
obtaining code configured to cause the at least one processor to obtain a plurality of images of a video, the plurality of images being divided into one or more groups;
first determining code configured to cause the at least one processor to determine first images among the plurality of images to which a parametric-based VQA is to be applied, the first images being all of the plurality of images, and determine a first score based on applying the parametric-based VQA to each of the first images;
second determining code configured to cause the at least one processor to determine second images among the plurality of images to which a sample-based VQA is to be applied, and determine a second score based on applying the sample-based VQA to each of the second images; and
output code configured to cause the at least one processor to output a final score for at least one image based on the first score and the second score.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the second determining code is further configured to cause the at least one processor to select at least one image in each of the one or more groups.

### Claim 12 (depends on 10)

The apparatus of claim 10, wherein the second determining code is further configured to cause the at least one processor to select images among the plurality of images at a predetermined time interval or a predetermined frame interval.

### Claim 13 (depends on 10)

The apparatus of claim 10, further comprising:
calibrating code configured to cause the at least one processor to, based on determining that the second score is not available for at least one of the first images, calibrate the first score.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the calibrating code is further configured to cause the at least one processor to:
obtain one or more second images corresponding to the one or more first images;
calculate a difference between a first scoring system of the parametric-based VQA and a second scoring system of the sample-based VQA based on the first score of the one or more first images and the second score of the one or more second images; and
calibrate the first score based on the difference between the first scoring system and the second scoring system.

### Claim 15 (depends on 10)

The apparatus of claim 10, further comprising:
adjusting code configured to cause the at least one processor to:
receive information about complexity of the video; and
adjust the first score based on the information about complexity of the video.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the information about complexity of the video comprises at least one from among a spatial textual information of the video, a temporal motion information of the video and a resolution of the video.

### Claim 17 (depends on 15)

The apparatus of claim 15, wherein the information about complexity of the video is included in at least one from among metadata and shutter interval information (SEI) message.

### Claim 18

A non-transitory computer-readable storage medium storing computer program code, the computer program code, when executed by at least one processor, the at least one processor is configured to:
obtain a plurality of images of a video, the plurality of images being divided into one or more groups;
determine first images among the plurality of images to which a parametric-based VQA is to be applied, the first images being all of the plurality of images, and determine a first score based on applying the parametric-based VQA to each of the first images;
determine second images among the plurality of images to which a sample-based VQA is to be applied, and determine a second score based on applying the sample-based VQA to each of the second images; and
output a final score for at least one image based on the first score and the second score.

### Claim 19 (depends on 18)

The non-transitory computer-readable storage medium of claim 18, wherein the at least one processor is further configured to:
based on determining that the second score is not available for at least one of the first images, calibrate the first score.

### Claim 20 (depends on 18)

The non-transitory computer-readable storage medium of claim 18, wherein the at least one processor is further configured to:
receive information about complexity of the video; and
adjust the first score based on the information about complexity of the video.
