# US 2010/0165409 A1 · Image processing apparatus, image processing method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0165409 A1
- Document ID: US20100165409A1
- Status: Published application
- Kind: A1
- Application number: 12/733,414
- Filed: 2008-09-02
- Published: 2010-07-01
- Earliest claimed: 2007-09-05
- Assignees: Sony Corporation
- Inventors: Makoto Tsukamoto; Jun Hirai; Ayataka Nishio; Naomasa Takahashi
- Web page: https://patentgrep.com/patent/US20100165409A1

## CPC

- G09G 3/2044: {using dithering}
- H04N 1/4052: {by error diffusion, i.e. transferring the binarising error to neighbouring dot decisions}
- G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)}
- G09G 2320/02: Improving the quality of display appearance
- G09G 2340/0428: Gradation resolution change
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present invention relates to an image processing apparatus, an image processing method, and a program capable of improving the visual quality of an image after grayscale conversion. A grayscale modulator 200, which is a ΔΣ modulator that converts the grayscale of an image, includes: an adder 250 that adds the pixel value of the image and the output of a feedback arithmetic unit 240; a quantizing unit 210 that quantizes the output of the adder 250 and outputs a quantized value including a quantization error as the result of the ΔΣ modulation; a subtractor 230 that calculates the difference between the output of the adder 250 and the quantized value of the output of the adder 250, thereby calculating the quantization error; and the feedback arithmetic unit 240 that filters the quantization error and outputs the filtering result to the adder 250. The filter coefficient of filtering by the feedback arithmetic unit 240 is determined such that the amplitude characteristics of noise shaping by the ΔΣ modulator in a frequency band that is equal to or more than an intermediate frequency band are the inverse characteristics of the spatial frequency characteristics of the human eye. The invention can be applied to convert the grayscale of an image.

## Claims

### Claim 1

An image processing apparatus comprising:
a ΔΣ modulation unit that performs ΔΣ modulation on an image to convert the grayscale of the image,
wherein the ΔΣ modulation unit includes:
an arithmetic unit that filters a quantization error;
an adding unit that adds a pixel value of the image and the output of the arithmetic unit;
a quantizing unit that quantizes the output of the adding unit and outputs a quantized value including the quantization error as the result of the ΔΣ modulation; and
a subtracting unit that calculates the difference between the output of the adding unit and the quantized value of the output of the adding unit, thereby calculating the quantization error, and
a filter coefficient of filtering by the arithmetic unit is determined such that the amplitude characteristics of noise shaping by the ΔΣ modulation unit in a frequency band that is equal to or more than an intermediate frequency band are the inverse characteristics of the spatial frequency characteristics of the human eye.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1,
wherein the filter coefficient of filtering by the arithmetic unit is determined such that the amplitude characteristics of noise shaping in the frequency band that is equal to or more than the intermediate frequency band are the inverse characteristics of the spatial frequency characteristics of the human eye, on the basis of the characteristics of equal to or more than a spatial frequency corresponding to the resolution of a display unit that displays the image subjected to the ΔΣ modulation, among the spatial frequency characteristics of the human eye.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1,
wherein the filter coefficient of filtering by the arithmetic unit is determined such that the amplitude characteristics of noise shaping by the ΔΣ modulation unit rapidly increase in a high frequency band, as compared to the amplitude characteristics of noise shaping by the ΔΣ modulation of a Floyd filter.

### Claim 4 (depends on 1)

The image processing apparatus according to claim 1,
wherein the filter coefficient of filtering by the arithmetic unit is determined such that the amplitude characteristics of noise shaping by the ΔΣ modulation unit are negative in a low or intermediate frequency band and rapidly increase in a high frequency band, as compared to the amplitude characteristics of noise shaping by the ΔΣ modulation of a Floyd filter.

### Claim 5 (depends on 1)

The image processing apparatus according to claim 1,
wherein the filter coefficient of filtering by the arithmetic unit includes a negative value and is determined such that the amplitude characteristics of noise shaping by the ΔΣ modulation unit rapidly increase in a high frequency band, as compared to the amplitude characteristics of noise shaping by the ΔΣ modulation of a Floyd filter.

### Claim 6

An image processing method performed in an image processing apparatus including a ΔΣ modulation unit that performs ΔΣ modulation on an image to convert the grayscale of the image, the ΔΣ modulation unit including an arithmetic unit that filters a quantization error, an adding unit that adds a pixel value of the image and the output of the arithmetic unit, a quantizing unit that quantizes the output of the adding unit and outputs a quantized value including the quantization error as the result of the ΔΣ modulation, and a subtracting unit that calculates the difference between the output of the adding unit and the quantized value of the output of the adding unit, thereby calculating the quantization error, the image processing method comprising the steps of:
allowing the adding unit to add the pixel value of the image and the output of the arithmetic unit;
allowing the quantizing unit to quantize the output of the adding unit and output the quantized value including the quantization error as the result of the ΔΣ modulation;
allowing the subtracting unit to calculate the difference between the output of the adding unit and the quantized value of the output of the adding unit, thereby calculating the quantization error; and
allowing the arithmetic unit to filter the quantization error and output the filtering result to the adding unit,
wherein a filter coefficient of filtering by the arithmetic unit is determined such that the amplitude characteristics of noise shaping by the ΔΣ modulation unit in a frequency band that is equal to or more than an intermediate frequency band are the inverse characteristics of the spatial frequency characteristics of the human eye.

### Claim 7

A program that allows a computer to function as a ΔΣ modulation unit that performs ΔΣ modulation on an image to convert the grayscale of the image,
wherein the ΔΣ modulation unit includes:
an arithmetic unit that filters a quantization error;
an adding unit that adds a pixel value of the image and the output of the arithmetic unit;
a quantizing unit that quantizes the output of the adding unit and outputs a quantized value including the quantization error as the result of the ΔΣ modulation; and
a subtracting unit that calculates the difference between the output of the adding unit and the quantized value of the output of the adding unit, thereby calculating the quantization error, and
a filter coefficient of filtering by the arithmetic unit is determined such that the amplitude characteristics of noise shaping by the ΔΣ modulation unit in a frequency band that is equal to or more than an intermediate frequency band are the inverse characteristics of the spatial frequency characteristics of the human eye.

### Claim 8

An image processing apparatus comprising:
an identity detecting unit that detects whether a pixel value of an interesting pixel is identical to a pixel value of a pixel around the interesting pixel in an image;
a noise generating unit that generates a random noise;
a first adding unit that adds the random noise to the pixel value of the interesting pixel and outputs the added value as the pixel value of the interesting pixel when it is detected that the pixel values are identical to each other, and outputs the pixel value of the interesting pixel without any change in the other cases; and
a ΔΣ modulation unit that performs ΔΣ modulation on the image to convert the grayscale of the image,
wherein the ΔΣ modulation unit includes:
an arithmetic unit that filters a quantization error;
a second adding unit that adds the pixel value of the interesting image output from the first adding unit and the output of the arithmetic unit;
a quantizing unit that quantizes the output of the second adding unit and outputs a quantized value including the quantization error as the result of the ΔΣ modulation; and
a subtracting unit that calculates the difference between the output of the second adding unit and the quantized value of the output of the second adding unit, thereby calculating the quantization error.

### Claim 9 (depends on 8)

The imaging processing apparatus according to claim 8,
wherein a filter coefficient of filtering by the arithmetic unit is determined such that the amplitude characteristics of noise shaping by the ΔΣ modulation unit in a frequency band that is equal to or more than an intermediate frequency band are the inverse characteristics of the spatial frequency characteristics of the human eye.

### Claim 10 (depends on 9)

The image processing apparatus according to claim 9,
wherein the filter coefficient of filtering by the arithmetic unit is determined such that the amplitude characteristics of noise shaping in the frequency band that is equal to or more than the intermediate frequency band are the inverse characteristics of the spatial frequency characteristics of the human eye, on the basis of the characteristics of equal to or more than a spatial frequency corresponding to the resolution of a display unit that displays the image subjected to the ΔΣ modulation, among the spatial frequency characteristics of the human eye.

### Claim 11 (depends on 9)

The image processing apparatus according to claim 9,
wherein the filter coefficient of filtering by the arithmetic unit is determined such that the amplitude characteristics of noise shaping by the ΔΣ modulation unit rapidly increase in a high frequency band, as compared to the amplitude characteristics of noise shaping by the ΔΣ modulation of a Floyd filter.

### Claim 12 (depends on 9)

The image processing apparatus according to claim 9,
wherein the filter coefficient of filtering by the arithmetic unit is determined such that the amplitude characteristics of noise shaping by the ΔΣ modulation unit are negative in a low or intermediate frequency band and rapidly increase in a high frequency band, as compared to the amplitude characteristics of noise shaping by the ΔΣ modulation of a Floyd filter.

### Claim 13 (depends on 9)

The image processing apparatus according to claim 9,
wherein the filter coefficient of filtering by the arithmetic unit includes a negative value and is determined such that the amplitude characteristics of noise shaping by the ΔΣ modulation unit rapidly increase in a high frequency band, as compared to the amplitude characteristics of noise shaping by the ΔΣ modulation of a Floyd filter.

### Claim 14

An image processing method performed in an image processing apparatus including an identity detecting unit that detects whether a pixel value of an interesting pixel is identical to a pixel value of a pixel around the interesting pixel in an image, a noise generating unit that generates a random noise, a first adding unit that adds the random noise to the pixel value of the interesting pixel and outputs the added value as the pixel value of the interesting pixel when it is detected that the pixel values are identical to each other and outputs the pixel value of the interesting pixel without any change in the other cases, and a ΔΣ modulation unit that performs ΔΣ modulation on the image to convert the grayscale of the image, the ΔΣ modulation unit including an arithmetic unit that filters a quantization error, a second adding unit that adds the pixel value of the interesting image output from the first adding unit and the output of the arithmetic unit, a quantizing unit that quantizes the output of the second adding unit and outputs a quantized value including the quantization error as the result of the ΔΣ modulation, and a subtracting unit that calculates the difference between the output of the second adding unit and the quantized value of the output of the second adding unit, thereby calculating the quantization error, the image processing method comprising the steps of:
allowing the first adding unit to add the random noise to the pixel value of the interesting pixel and output the added value as the pixel value of the interesting pixel when it is detected that the pixel values are identical to each other, and to output the pixel value of the interesting pixel without any change in the other cases;
allowing the second adding unit to add the pixel value of the interesting image output from the first adding unit and the output of the arithmetic unit;
allowing the quantizing unit to quantize the output of the second adding unit and output the quantized value including the quantization error as the result of the ΔΣ modulation;
allowing the subtracting unit to calculate the difference between the output of the second adding unit and the quantized value of the output of the second adding unit, thereby calculating the quantization error; and
allowing the arithmetic unit to filter the quantization error and output the filtering result to the second adding unit.

### Claim 15

A program that allows a computer to function as:
an identity detecting unit that detects whether a pixel value of an interesting pixel is identical to a pixel value of a pixel around the interesting pixel in an image;
a noise generating unit that generates a random noise;
a first adding unit that adds the random noise to the pixel value of the interesting pixel and outputs the added value as the pixel value of the interesting pixel when it is detected that the pixel values are identical to each other, and outputs the pixel value of the interesting pixel without any change in the other cases; and
a ΔΣ modulation unit that performs ΔΣ modulation on the image to convert the grayscale of the image,
wherein the ΔΣ modulation unit includes:
an arithmetic unit that filters a quantization error;
a second adding unit that adds the pixel value of the interesting image output from the first adding unit and the output of the arithmetic unit;
a quantizing unit that quantizes the output of the second adding unit and outputs a quantized value including the quantization error as the result of the ΔΣ modulation; and
a subtracting unit that calculates the difference between the output of the second adding unit and the quantized value of the output of the second adding unit, thereby calculating the quantization error.
