# US 2021/0082089 A1 · Image processing apparatus, image processing method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0082089 A1
- Document ID: US20210082089A1
- Status: Published application
- Kind: A1
- Application number: 17/018,645
- Filed: 2020-09-11
- Published: 2021-03-18
- Earliest claimed: 2019-09-13
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Yosuke Takada
- Web page: https://patentgrep.com/patent/US20210082089A1

## CPC

- G06T 5/70: Denoising; Smoothing
- G06T 7/13: Edge detection
- G06T 2207/10024: Color image
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T 2207/20182: Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing apparatus includes a setting unit, a small region setting unit, a determination unit, a search unit, a noise reduction unit, and a synthesis unit. The setting unit sets a target patch in an input image. The small region setting unit sets a small region near the target patch. The determination unit determines a number of similar patches to be detected as a patch similar to the target patch based on a noise amount in the small region. The search unit searches the input image for the similar patch based on the number of similar patches. The noise reduction unit configured to perform noise reduction processing with respect to the target patch using the target patch and the similar patch. The synthesis unit generates an image by synthesizing a plurality of patch groups subjected to the noise reduction processing.

## Claims

### Claim 1

An image processing apparatus comprising:
a setting unit configured to set a target patch in an input image;
a small region setting unit configured to set a small region near the target patch;
a determination unit configured to determine a number of similar patches to be detected as a patch similar to the target patch based on a noise amount in the small region;
a search unit configured to search the input image for the similar patch based on the number of similar patches;
a noise reduction unit configured to perform noise reduction processing with respect to the target patch using the target patch and the similar patch; and
a synthesis unit configured to generate an image by synthesizing a plurality of patch groups subjected to the noise reduction processing.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein the determination unit is configured to determine a search region to be searched for the similar patch based on the noise amount in the small region and a size of the target patch.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1, wherein the determination unit is configured to determine the number of similar patches using the noise amount in the small region and auxiliary information.

### Claim 4 (depends on 3)

The image processing apparatus according to claim 3,
wherein the auxiliary information is a ratio of the noise amount in the small region to a noise amount measured in advance for each sensitivity, and
wherein the determination unit determines a larger number of similar patches as the ratio becomes smaller.

### Claim 5 (depends on 3)

The image processing apparatus according to claim 3,
wherein the auxiliary information is a value indicating an edge intensity in the small region, and
wherein the determination unit determines a larger number of similar patches as a value of the edge intensity becomes smaller.

### Claim 6 (depends on 3)

The image processing apparatus according to claim 3,
wherein the auxiliary information is a representative value of a high-frequency component in a Fourier spectrum in the small region, and
wherein the determination unit determines a larger number of similar patches as the representative value becomes smaller.

### Claim 7 (depends on 3)

The image processing apparatus according to claim 3,
wherein the auxiliary information is a differential value in the small region, and
wherein the determination unit determines a larger number of similar patches as the differential value becomes smaller.

### Claim 8 (depends on 3)

The image processing apparatus according to claim 3,
wherein the auxiliary information is saturation of the target patch or the small region, and
wherein the determination unit determines a larger number of similar patches as the saturation becomes larger.

### Claim 9 (depends on 8)

The image processing apparatus according to claim 8, wherein the determination unit is configured to separate a signal from the target patch or the small region into a luminance signal and a color difference signal and, in a case where noise reduction processing is performed on the luminance signal and the color difference signal, the determination unit determines a larger number of similar patches used for noise reduction processing on the color difference signal than the number of similar patches used for noise reduction processing on the luminance signal if the saturation, as calculated from the color difference signal, is a determination value or more.

### Claim 10

A method for an image processing apparatus, the method comprising:
setting a target patch in an input image;
setting a small region near the target patch;
determining a number of similar patches to be detected as a patch similar to the target patch based on a noise amount in the small region;
searching the input image for the similar patch based on the number of similar patches;
performing noise reduction processing with respect to the target patch using the target patch and the similar patch; and
generating an image by synthesizing a plurality of patch groups subjected to the noise reduction processing.

### Claim 11 (depends on 10)

The method according to claim 10, wherein determining includes determining a search region to be searched for the similar patch based on the noise amount in the small region and a size of the target patch.

### Claim 12 (depends on 10)

The method according to claim 10, wherein determining includes determining the number of similar patches using the noise amount in the small region and auxiliary information.

### Claim 13 (depends on 12)

The method according to claim 12,
wherein the auxiliary information is a ratio of the noise amount in the small region to a noise amount measured in advance for each sensitivity, and
wherein determining includes determining a larger number of similar patches as the ratio becomes smaller.

### Claim 14 (depends on 12)

The method according to claim 12,
wherein the auxiliary information is a value indicating an edge intensity in the small region, and
wherein determining includes determining a larger number of similar patches as a value of the edge intensity becomes smaller.

### Claim 15 (depends on 12)

The method according to claim 12,
wherein the auxiliary information is a representative value of a high-frequency component in a Fourier spectrum in the small region, and
wherein determining includes determining a larger number of similar patches as the representative value becomes smaller.

### Claim 16 (depends on 12)

The method according to claim 12,
wherein the auxiliary information is a differential value in the small region, and
wherein determining includes determining a larger number of similar patches as the differential value becomes smaller.

### Claim 17 (depends on 12)

The method according to claim 12,
wherein the auxiliary information is saturation of the target patch or the small region, and
wherein determining includes determining a larger number of similar patches as the saturation becomes larger.

### Claim 18 (depends on 17)

The method according to claim 17, wherein determining includes separating a signal from the target patch or the small region into a luminance signal and a color difference signal and, in a case where noise reduction processing is performed on the luminance signal and the color difference signal, determining includes determining a larger number of similar patches used for noise reduction processing on the color difference signal than the number of similar patches used for noise reduction processing on the luminance signal if the saturation, as calculated from the color difference signal, is a determination value or more.

### Claim 19

A non-transitory computer-readable storage medium storing a program to cause a computer to perform a method for an image processing apparatus, the method comprising:
setting a target patch in an input image;
setting a small region near the target patch;
determining a number of similar patches to be detected as a patch similar to the target patch based on a noise amount in the small region;
searching the input image for the similar patch based on the number of similar patches;
performing noise reduction processing with respect to the target patch using the target patch and the similar patch; and
generating an image by synthesizing a plurality of patch groups subjected to the noise reduction processing.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium according to claim 19, wherein determining includes determining a search region to be searched for the similar patch based on the noise amount in the small region and a size of the target patch.
