# US 2016/0260200 A1 · Image processing device and image processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0260200 A1
- Document ID: US20160260200A1
- Status: Published application
- Kind: A1
- Application number: 14/426,860
- Filed: 2013-09-10
- Published: 2016-09-08
- Earliest claimed: 2012-09-11
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Eita KOBAYASHI; Takashi TAKENAKA
- Web page: https://patentgrep.com/patent/US20160260200A1

## CPC

- G06T 5/70: Denoising; Smoothing
- G06T 5/10: using non-spatial domain filtering
- G06T 2207/20016: Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
- G06T 2207/20064: Wavelet transform [DWT]
- H04N 1/409: Edge or detail enhancement; Noise or error suppression
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Provided is an image processing device for performing noise removal in which a plurality of noise removal actions are combined while minimizing necessary resources. The image processing device is provided with: a first frequency separation unit for separating the input image by frequency into a first low-frequency component and a first high-frequency component containing a higher-frequency component than the first low-frequency component; a second frequency separation unit for separating the first low-frequency component into a second low-frequency component and a second high-frequency component containing a higher-frequency component than the second low-frequency component; a first image transform unit for performing noise removal on the second low-frequency component and the second high-frequency component and outputting the noise-removed image as a first transformed image; and a second image transform unit for performing noise removal on the first high-frequency component and the first transformed image with less resources being allocated than those allocated to the first image transform unit, and outputting the noise-removed image as a second transformed image.

## Claims

### Claim at position 1

-8. (canceled)

### Claim 9

An image processing device comprising:
a first frequency separation unit, implemented by at least one hardware, which receives an input image and performs frequency separation on the input image into a first low-frequency component and a first high-frequency component that includes a higher-frequency component than the first low-frequency component;
a second frequency separation unit, implemented by at least one hardware, which separates the first low-frequency component into a second low-frequency component and a second high-frequency component that includes a higher-frequency component than the second low-frequency component;
a first image transform unit, implemented by at least one hardware, which performs noise removal on the second low-frequency component and on the second high-frequency component, and outputs a noise-removed image as a first transformed image; and
a second image transform unit, implemented by at least one hardware, which performs noise removal on the first high-frequency component and on the first transformed image, with fewer resources allocated than those allocated to the first image transform unit, and outputs a noise-removed image as a second transformed image.

### Claim 10 (depends on 9)

The image processing unit according to claim 9,
wherein the first frequency separation unit comprises a first wavelet transform unit which performs a wavelet transform,
and wherein the second frequency separation unit comprises a second wavelet transform unit which performs a wavelet transform.

### Claim 11 (depends on 10)

The image processing device according to claim 10,
wherein the first image transform unit comprises:
a first wavelet shrinkage unit, implemented by at least one hardware, which compares a wavelet coefficient for the second high-frequency component with a first threshold value, and shrinks any wavelet coefficient that is smaller than the first threshold value; and
a first inverse wavelet transform unit, implemented by at least one hardware, which reconstructs an image by performing an inverse wavelet transform on a signal that is output from the first wavelet shrinkage unit and on the second low-frequency component,
and wherein the second image transform unit comprises:
a second wavelet shrinkage unit, implemented by at least one hardware, which compares a wavelet coefficient for the first high-frequency component with a second threshold value, and shrinks any wavelet coefficient that is smaller than the second threshold value; and
a second inverse wavelet transform unit, implemented by at least one hardware, which reconstructs an image by performing an inverse wavelet transform on a signal that is output from the second wavelet shrinkage unit and on the first transformed image.

### Claim 12 (depends on 11)

The image processing device according to claim 11,
wherein a first basis function employed in the first wavelet transform unit and the first inverse wavelet transform unit is different from a second basis function employed in the second wavelet transform unit and the second inverse wavelet transform unit.

### Claim 13 (depends on 12)

The image processing device according to claim 12,
wherein the first wavelet transform unit, the first inverse wavelet transform unit, the second wavelet transform unit, and the second inverse wavelet transform unit each comprise a line buffer which stores pixels of the input image in a scanning direction,
and wherein the first wavelet transform unit and the first inverse wavelet transform unit each comprise a first line buffer whose number of lines is less than that of a second line buffer which the second wavelet transform unit and the second inverse wavelet transform unit each comprise.

### Claim 14 (depends on 9)

The image processing device according to claim 9,
wherein the first and/or second image transform unit comprises an image correction unit which performs image correction on a noise-removed image.

### Claim 15 (depends on 11)

The image processing device according to claim 11,
wherein a pipeline architecture is configured by the first wavelet transform unit, the first wavelet shrinkage unit, the first inverse wavelet transform unit, the second wavelet transform unit, the second wavelet shrinkage unit, and the second inverse wavelet transform unit.

### Claim 16

A method for processing an image, implemented by at least one processor, the method comprising:
a first frequency separation step of receiving an input image and performing frequency separation on the input image into a first low-frequency component and a first high-frequency component which includes a higher-frequency component than the first low-frequency component;
a second frequency separation step of separating the first low-frequency component into a second low-frequency component and a second high-frequency component which includes a higher-frequency component than the second low-frequency component;
a first image transform step of outputting a first transformed image by performing noise removal on the second low-frequency component and on the second high-frequency component; and
a second image transform step of outputting a second transformed image by performing noise removal on the first high-frequency component and on the first transformed image with resources fewer than those used for the first image transform step.

### Claim 17

A non-transitory computer-readable medium with instructions stored thereon, that when executed by a processor, perform the steps comprising:
receiving an input image and performing frequency separation on the input image into a first low-frequency component and a first high-frequency component which includes a higher-frequency component than the first low-frequency component;
separating the first low-frequency component into a second low-frequency component and a second high-frequency component which includes a higher-frequency component than the second low-frequency component;
outputting a first transformed image by performing noise removal on the second low-frequency component and on the second high-frequency component; and
outputting a second transformed image by performing noise removal on the first high-frequency component and on the first transformed image with resources fewer than those used for the first image transform step.
