# US 2010/0074554 A1 · Image processing apparatus, control method therefor, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0074554 A1
- Document ID: US20100074554A1
- Status: Published application
- Kind: A1
- Application number: 12/557,410
- Filed: 2009-09-10
- Published: 2010-03-25
- Earliest claimed: 2008-09-24
- Assignees: Canon Kabushiki Kaisha
- Inventors: Takashi Gyotoku
- Web page: https://patentgrep.com/patent/US20100074554A1

## CPC

- G02B 27/0006: {with means to keep optical surfaces clean, e.g. by preventing or removing dirt, stains, contamination, condensation (G02B1/18 takes precedence; cleaning in general B08B)}
- G03B 17/02: Bodies
- H04N 1/4097: {Removing errors due external factors, e.g. dust, scratches}
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/634: {Warning indications}
- H04N 23/811: {by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor}
- H04N 23/843: {Demosaicing, e.g. interpolating colour pixel values}
- H04N 25/683: by defect estimation performed on the scene signal, e.g. real time or on the fly detection
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing apparatus which corrects input image data based on the image data and foreign substance information containing information on the position and size of a foreign substance includes a correction unit which corrects the influence of the shadow of the foreign substance contained in the image data, based on the image data and the foreign substance information, a still image uniformity determination unit which determines the uniformity of an image in a region around the foreign substance, a moving image uniformity determination unit which determines the uniformity of the image in the region around the foreign substance based on a determination criterion different from one applied to a still image, and a control unit which inhibits correction of the image data when the still image uniformity determination unit or moving image uniformity determination unit determines that the uniformity is less than or equal to a predetermined value.

## Claims

### Claim 1

An image processing apparatus which corrects input image data based on the image data and foreign substance information containing information on a position and size of a foreign substance adhering to an optical element arranged in front of an image sensor in an image capturing apparatus that captures the image data, the apparatus comprising:
a correction unit which corrects the image data so as to reduce influence of a shadow of the foreign substance contained in the image data, based on the image data and the foreign substance information;
a still image uniformity determination unit which determines uniformity of an image in a region around the foreign substance in the image data, said still image uniformity determination unit being applied when input image data is a still image;
a moving image uniformity determination unit which determines the uniformity of the image in the region around the foreign substance in the image data based on a determination criterion different from a determination criterion applied to a still image by said still image uniformity determination unit, said moving image uniformity determination unit being applied when input image data is a moving image; and
a control unit which inhibits correction of the image data by said correction unit when either of said still image uniformity determination unit and said moving image uniformity determination unit determines that the uniformity is not larger than a predetermined value.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein said moving image uniformity determination unit comprises
an edge detection unit which performs edge detection for a frame forming a moving image,
a foreign substance edge detection unit which detects a frame in which an edge detected by said edge detection unit and a foreign substance image overlap each other, and
a moving image correction determination unit which determines, based on the number of frames which are detected by said foreign substance edge detection unit and in which the foreign substance image and the edge overlap each other, whether to correct the foreign substance image contained in data of the moving image.

### Claim 3 (depends on 1)

The apparatus according to claim 1, wherein said moving image uniformity determination unit uses, as the determination criterion for determining uniformity, a criterion for determining that even a complicated image in the region around the foreign substance is uniform, unlike the determination criterion used in said still image uniformity determination unit.

### Claim 4

A method of controlling an image processing apparatus which corrects input image data, based on the image data and foreign substance information containing information on a position and size of a foreign substance adhering to an optical element arranged in front of an image sensor in an image capturing apparatus that captures the image data, the method comprising:
a correction step of correcting the image data so as to reduce influence of a shadow of the foreign substance contained in the image data, based on the image data and the foreign substance information;
a still image uniformity determination step of determining uniformity of an image in a region around the foreign substance in the image data, the still image uniformity determination step being applied when input image data is a still image;
a moving image uniformity determination step of determining the uniformity of the image in the region around the foreign substance in the image data based on a determination criterion different from a determination criterion applied to a still image in the still image uniformity determination step, the moving image uniformity determination step being applied when input image data is a moving image; and
a control step of inhibiting correction of the image data in the correction step when uniformity is determined in either of the still image uniformity determination step and the moving image uniformity determination step to be not larger than a predetermined value.

### Claim 5 (depends on 4)

A program for causing a computer to execute a control method defined in claim 4.
