# US 2013/0155193 A1 · Image quality evaluation apparatus and method of controlling the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0155193 A1
- Document ID: US20130155193A1
- Status: Published application
- Kind: A1
- Application number: 13/708,506
- Filed: 2012-12-07
- Published: 2013-06-20
- Earliest claimed: 2011-12-15
- Assignees: Canon Kabushiki Kaisha
- Inventors: Satoshi Ikeda
- Web page: https://patentgrep.com/patent/US20130155193A1

## CPC

- G06T 5/70: Denoising; Smoothing
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- H04N 13/20: Image signal generators
- H04N 17/02: for colour television signals
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20182: Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
- G06T 2207/30168: Image quality inspection
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Autocorrelation coefficients for three dimensions defined by the horizontal direction, the vertical direction, and the time direction of evaluation target moving image data are acquired. A plurality of noise amounts are calculated by executing frequency analysis of the acquired autocorrelation coefficients for the three dimensions and multiplying each frequency analysis result by a visual response function representing the visual characteristic of a spatial frequency or a time frequency. The product of the plurality of calculated noise amounts is calculated as the moving image noise evaluation value of the evaluation target moving image data.

## Claims

### Claim 1

An image quality evaluation apparatus for evaluating a noise characteristic of a moving image, comprising:
an acquisition unit configured to acquire autocorrelation coefficients for three dimensions defined by a horizontal direction, a vertical direction, and a time direction of evaluation target moving image data;
a calculation unit configured to calculate a plurality of noise amounts by executing frequency analysis of the autocorrelation coefficients for the three dimensions acquired by said acquisition unit and multiplying each frequency analysis result by a visual response function representing a visual characteristic of one of a spatial frequency and a time frequency; and
an evaluation value calculation unit configured to calculate a product of the plurality of noise amounts calculated by said calculation unit as a moving image noise evaluation value of the evaluation target moving image data.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein said calculation unit calculates
a first noise amount calculated for the one-dimensional horizontal direction, a second noise amount calculated for the one-dimensional vertical direction, and a third noise amount calculated for the one-dimensional time direction, or
a first noise amount calculated for a two-dimensional space defined by the horizontal direction and the vertical direction, and a second noise amount calculated for the one-dimensional time direction.

### Claim 3 (depends on 1)

The apparatus according to claim 1, further comprising:
a conversion unit configured to convert a color space of the evaluation target moving image data; and
an extraction unit configured to extract only a moving image noise component from the moving image data converted by said conversion unit,
wherein said acquisition unit acquires, for the moving image noise component extracted by said extraction unit, the autocorrelation coefficients for the three dimensions defined by the horizontal direction, the vertical direction, and the time direction of evaluation target moving image data;

### Claim 4 (depends on 3)

The apparatus according to claim 3, wherein said extraction unit calculates a temporal DC component by averaging the evaluation target moving image data in the time direction, and subtracting the calculated DC component from the moving image data, thereby extracting the moving image noise component.

### Claim 5 (depends on 1)

The apparatus according to claim 1, further comprising a designation unit configured to, when at least one of noise characteristics in the horizontal direction, the vertical direction, and the time direction of the evaluation target moving image data has changed after said evaluation value calculation unit has calculated the moving image noise evaluation value for the evaluation target moving image data, designate a direction of the noise characteristic that has changed,
wherein said acquisition unit newly acquires an autocorrelation coefficient for the direction designated by said designation unit,
said calculation unit recalculates the noise amount for the autocorrelation coefficient newly acquired by said acquisition unit, and
said evaluation value calculation unit calculates a product of the noise amount recalculated by said calculation unit and a noise amount for a direction in which the noise characteristic has not changed as a new moving image noise evaluation value of the evaluation target moving image data.

### Claim 6 (depends on 1)

The apparatus according to claim 1, further comprising an output unit configured to output the evaluation target moving image data to a display,
wherein each of said acquisition unit, said calculation unit, and said evaluation value calculation unit is executed for a captured image of the evaluation target moving image data output to the display by said output unit, thereby calculating the moving image noise evaluation value in consideration of a dynamic characteristic of the display.

### Claim 7

A method of controlling an image quality evaluation apparatus for evaluating a noise characteristic of a moving image, comprising:
an acquisition step of, by an acquisition unit, acquiring autocorrelation coefficients for three dimensions defined by a horizontal direction, a vertical direction, and a time direction of evaluation target moving image data;
a calculation step of, by a calculation unit, calculating a plurality of noise amounts by executing frequency analysis of the autocorrelation coefficients for the three dimensions acquired in the acquisition step and multiplying each frequency analysis result by a visual response function representing a visual characteristic of one of a spatial frequency and a time frequency; and
an evaluation value calculation step of, by an evaluation value calculation unit, calculating a product of the plurality of noise amounts calculated in the calculation step as a moving image noise evaluation value of the evaluation target moving image data.

### Claim 8

A computer-readable storage medium which stores a program that causes a computer to control an image quality evaluation apparatus for evaluating a noise characteristic of a moving image, causing the computer to function as:
an acquisition unit configured to acquire autocorrelation coefficients for three dimensions defined by a horizontal direction, a vertical direction, and a time direction of evaluation target moving image data;
a calculation unit configured to calculate a plurality of noise amounts by executing frequency analysis of the autocorrelation coefficients for the three dimensions acquired by said acquisition unit and multiplying each frequency analysis result by a visual response function representing a visual characteristic of one of a spatial frequency and a time frequency; and
an evaluation value calculation unit configured to calculate a product of the plurality of noise amounts calculated by said calculation unit as a moving image noise evaluation value of the evaluation target moving image data.
