# US 2001/0022857 A1 · Image processing method and image processing apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2001/0022857 A1
- Document ID: US20010022857A1
- Status: Published application
- Kind: A1
- Application number: 09/764,381
- Filed: 2001-01-19
- Published: 2001-09-20
- Earliest claimed: 2000-01-21
- Assignees: Matsushita Electric Industrial Co., Ltd.
- Inventors: Satoshi Kondo; Toshiyuki Shimada; Masahiro Honjo; Masao Kitagawa
- Web page: https://patentgrep.com/patent/US20010022857A1

## CPC

- G06T 5/70: Denoising; Smoothing
- H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing apparatus comprises a noise detection means for performing noise detection on an input image; a noise removal means for removing noise from a predetermined region of the input image, on the basis of the result of the noise detection; a counting means for obtaining the ratio of an area targeted for noise removal to the predetermined region of the input image; a statistics calculation means for obtaining the statistics on the ratios obtained by the counting means over a predetermined period of time; an image generation means for generating an image indicating the statistics; and an image composition means for superimposing the image generated by the image generation means on the image outputted from the noise removal means to generate a composite image for display. Therefore, the viewer can easily know how much noise is removed from the predetermined region of the input image, for every predetermined period of time.

## Claims

### Claim 1

An image processing method comprising:
noise detection step of performing noise detection on an image;
noise removal step of removing noise from a predetermined region of the image, on the basis of the result of the noise detection;
arithmetic step of obtaining the ratio of an area targeted for noise removal to the predetermined region of the image, on the basis of the result of the noise detection; and
image generation step of generating an image indicating the ratio, on the basis of the ratio obtained in the arithmetic step.

### Claim 2

An image processing method comprising:
noise detection step of performing noise detection on an image;
noise removal step of removing noise from a predetermined region of the image, on the basis of the result of the noise detection;
arithmetic step of obtaining the ratio of an area targeted for noise removal to the predetermined region of the image, from the result of the noise detection;
statistics calculation step of obtaining the statistics on the ratios obtained in the arithmetic step over a predetermined period of time;
image generation step of generating an image indicating the statistics, on the basis of the statistics obtained in the statistics calculation step; and
image composition step of superimposing the image generated in the image generation step on the image before being subjected to noise removal in the noise removal step or on the image from which noise has been removed, to generate a composite image for display.

### Claim 3

An image processing method comprising:
noise detection step of detecting the position and intensity of noise in an image;
noise removal step of removing noise from a predetermined region of the image, on the basis of the position and intensity of noise detected in the noise detection step;
arithmetic step of obtaining, for each intensity level of noise, the ratio of an area targeted for noise removal to the predetermined region of the image, on the basis of the position and intensity of noise detected in the noise detection step; and
image generation step of generating an image indicating the ratio for each intensity level of noise, on the basis of the ratio obtained in the arithmetic step.

### Claim 4

An image processing method comprising:
noise detection step of performing detection of position and intensity of noise, on an image;
noise removal step of removing noise from a predetermined region of the image, on the basis of the position and intensity of noise detected in the noise detection step;
arithmetic step of obtaining, for each intensity level of noise, the ratio of an area targeted for noise removal to the predetermined region of the image, on the basis of the position and intensity of noise detected in the noise detection step;
statistics calculation step of obtaining, for each intensity level of noise, the statistics on the ratios obtained in the arithmetic step over a predetermined period of time;
image generation step of generating an image indicating the statistics, for each intensity level of noise, on the basis of the statistics obtained in the statistics calculation step; and
image composition step of superimposing the image generated in the image generation step on the image before being subjected to noise removal in the noise removal step or on the image from which noise has been removed, to generate a composite image for display.

### Claim 5

An image processing method comprising:
noise detection step of detecting the position and intensity of noise in an image;
noise removal step of removing noise from the image, on the basis of the position and intensity of noise detected in the noise detection step;
image generation step of generating an image indicating pixels included in an area of the image targeted for noise removal, using a predetermined color according to the intensity of noise, on the basis of the position and intensity of noise detected in the noise detection step; and
image composition step of superimposing the image generated in the image generation step on the image before being subjected to noise removal in the noise removal step or on the image from which noise has been removed, to generate a composite image for display.

### Claim 6

An image processing method comprising:
noise detection step of detecting noise in an image;
noise removal step of removing noise from the image on the basis of the result of the noise detection; and
image composition step of spatially combining a part of the image before being subjected to noise removal in the noise removal step with a part of the image from which noise has been removed, to generate a composite image for display.

### Claim 7 (depends on 5)

An image processing method as defined in claim 5, wherein the intensity of the noise detected in the noise detection step is only one, and the color of the image generated in the image generation step is only one.

### Claim 8 (depends on 6)

An image processing method as defined in claim 6, wherein the image composition step comprises cutting partial images of the same region from the image before being subjected to noise removal in the noise removal step and the image from which noise has been removed, respectively, and generating an image in which the partial images are arranged vertically or horizontally.

### Claim 9 (depends on 1, 2, 3, 4, 5, 6)

An image processing method as defined in any of claims 1 to 6 further comprising:
image decoding step of decoding an image code sequence to generate a decoded image;
said noise detection step of performing noise detection using information included in the image code sequence; and
said noise removal step of removing noise from the decoded image obtained in the image decoding step, on the basis of the result of the noise detection.

### Claim 10 (depends on 1, 2, 3, 4, 5, 6)

An image processing method as defined in any of claims 1 to 6, wherein said noise is one of blocking artifact and ringing artifact.

### Claim 11 (depends on 1, 2, 3, 4, 5, 6)

An image processing method as defined in any of claims 1 to 6, wherein the predetermined region to be subjected to noise removal in the noise removal step is an assembly of pixels in the vicinity of a boundary of each block.

### Claim 12

An image processing apparatus comprising:
noise detection means for performing noise detection on an input image;
noise removal means for removing noise from a predetermined region of the input image, on the basis of the result of the noise detection;
arithmetic means for obtaining the ratio of an area targeted for noise removal to the predetermined region of the input image, on the basis of the result of the noise detection; and
image generation means for generating an image indicating the ratio, on the basis of the ratio obtained by the arithmetic means.

### Claim 13

An image processing apparatus comprising:
noise detection means for performing noise detection on an input image;
noise removal means for removing noise from a predetermined region of the input image, on the basis of the result of the noise detection;
arithmetic means for obtaining the ratio of an area targeted for noise removal to the predetermined region of the input image, from the result of the noise detection;
statistics calculation means for obtaining the statistics on the ratios obtained by the arithmetic means over a predetermined period of time;
image generation means for generating an image indicating the statistics, on the basis of the statistics obtained by the statistics calculation means; and
image composition means for superimposing the image generated by the image generation means on the image before being subjected to noise removal by the noise removal means or on the image from which noise has been removed, to generate a composite image for display.

### Claim 14

An image processing apparatus comprising:
noise detection means for performing detection of position and intensity of noise, on an input image;
noise removal means for removing noise from a predetermined region of the input image, on the basis of the position and intensity of noise detected by the noise detection means;
arithmetic means for obtaining, for each intensity level of noise, the ratio of an area targeted for noise removal to the predetermined region of the input image, on the basis of the position and intensity of noise detected by the noise detection means; and
image generation means for generating an image indicating the ratio for each intensity level of noise, on the basis of the ratio obtained by the arithmetic means.

### Claim 15

An image processing apparatus comprising:
noise detection means for performing detection of position and intensity of noise, on an input image;
noise removal means for removing noise from a predetermined region of the input image, on the basis of the position and intensity of noise detected by the noise detection means;
arithmetic means for obtaining, for each intensity level of noise, the ratio of an area targeted for noise removal to the predetermined region of the input image, on the basis of the position and intensity of noise detected by the noise detection means;
statistics calculation means for obtaining, for each intensity level of noise, the statistics on the ratios obtained by the arithmetic means over a predetermined period of time;
image generation means for generating an image indicating the statistics, for each intensity level of noise, on the basis of the statistics obtained by the statistics calculation means; and
image composition means for superimposing the image generated by the image generation means on the image before being subjected to noise removal by the noise removal means or on the image from which noise has been removed, to generate a composite image for display.

### Claim 16

An image processing apparatus comprising:
noise detection means for performing detection of position and intensity of noise, on an input image;
noise removal means for removing noise from the input image, on the basis of the position and intensity of noise detected by the noise detection means;
image generation means for generating an image indicating pixels included in an area of the input image targeted for noise removal, using a predetermined color according to the intensity of noise, on the basis of the position and intensity of noise detected by the noise detection means; and
image composition means for superimposing the image generated by the image generation means on the image before being subjected to noise removal by the noise removal means or on the image from which noise has been removed, to generate a composite image for display.

### Claim 17

An image processing apparatus comprising:
noise detection means for performing noise detection on an input image;
noise removal means for removing noise from the input image on the basis of the result of the noise detection; and
image composition means for receiving the input image and the output image from the noise removal means, and spatially combining a part of the input image with a part of the output image from the noise removal means, to generate a composite image to be output.

### Claim 18 (depends on 16)

An image processing apparatus as defined in claim 16, wherein the intensity of the noise detected by the noise detection means is only one, and the color of the image generated by the image generation means is only one.

### Claim 19 (depends on 17)

An image processing apparatus as defined in claim 17, wherein the image composition means cuts partial images of the same region from the input image and the output image from the noise removal means, respectively, and generates an image in which the partial images are arranged vertically or horizontally.

### Claim 20 (depends on 12, 13, 14, 15, 16, 17)

An image processing apparatus as defined in any of claims 12 to 17 further comprising:
image decoding means for decoding an image code sequence to generate a decoded image;
said noise detection means receiving the image code sequence, and performing noise detection using information included in the image code sequence; and
said noise removal means removing noise from the decoded image outputted from the image decoding means, on the basis of the result of the noise detection.

### Claim 21 (depends on 12, 13, 14, 15, 16, 17)

An image processing apparatus as defined in any of claims 12 to 17, wherein said noise is one of blocking artifact and ringing artifact.

### Claim 22 (depends on 12, 13, 14, 15, 16, 17)

An image processing apparatus as defined in any of claims 12 to 17, wherein the predetermined region to be subjected to noise removal by the noise removal means is an assembly of pixels in the vicinity of a boundary of each block.
