# US 2008/0259187 A1 · System for and method of image processing and computer program for causing computer to execute the method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0259187 A1
- Document ID: US20080259187A1
- Status: Published application
- Kind: A1
- Application number: 12/105,662
- Filed: 2008-04-18
- Published: 2008-10-23
- Earliest claimed: 2007-04-18
- Assignees: FUJIFILM Corporation
- Inventors: Katsutoshi IZAWA
- Web page: https://patentgrep.com/patent/US20080259187A1

## CPC

- G06T 5/70: Denoising; Smoothing
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- G06V 10/143: Sensing or illuminating at different wavelengths
- G06V 10/30: Noise filtering
- H04N 23/81: for suppressing or minimising disturbance in the image signal generation
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- G06T 2207/10152: Varying illumination
- G06T 2207/20012: Locally adaptive
- G06T 2207/20192: Edge enhancement; Edge preservation
- H04N 23/673: {based on contrast or high frequency components of image signals, e.g. hill climbing method}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing apparatus includes an edge detecting portion which detects edges contained in a first image, out of first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter, and a noise reduction portion which carries out noise reduction processing on the second image to avoid the edges and obtains a processed image.

## Claims

### Claim 1

An image processing apparatus comprising
an edge detecting means which detects edges contained in a first image, out of first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter, and
a noise reduction means which carries out noise reduction processing on the second image to avoid the edges and obtains a processed image.

### Claim 2 (depends on 1)

An image processing apparatus as defined in claim 1 in which the image data representing the first image comprises RGB data, and the edge detecting means comprises a means for detecting the edges from an image represented at least one of the brightness data and two color difference data generated from the RGB data.

### Claim 3

An image processing apparatus comprising
an edge detecting means which detects edges as first and second edge information contained in first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter,
a difference detecting means which detects a difference of the images at the corresponding points in the first and second images and
a noise reduction means which carries out noise reduction processing on the second image according to the first and second edge information and existence of the difference of the images in the first image, and obtains a processed image.

### Claim 4 (depends on 3)

An image processing apparatus as defined in claim 3 in which the noise reduction means comprises a means which carries out the noise reduction processing on the second image to avoid the edges based on the first edge information where it may be considered that there is no difference of the images in the second image and carries out the noise reduction processing on the second image to avoid the edges based on the second edge information where it may be considered that there is a difference of the images in the second image.

### Claim 5 (depends on 3)

An image processing apparatus as defined in claim 3 in which the difference detecting means comprises a means which detects the absolute value of the difference of the pixels at the corresponding points in the first and second images as the difference of the images.

### Claim 6 (depends on 3)

An image processing apparatus as defined in claim 3 in which the image data representing the first and second images comprises RGB data, the edge detecting means comprises means for detecting the edges from an image represented at least one of the brightness data and two color difference data generated from the RGB data.

### Claim 7 (depends on 3)

An image processing apparatus as defined in claim 3 in which the first and second images are obtained at the same shutter speed.

### Claim 8 (depends on 7)

An image processing apparatus as defined in claim 7 in which the image data representing the first and second images comprises RGB data, the difference detecting means comprises a means which detects the difference on the basis of the B color data.

### Claim 9

An image processing apparatus comprising
an edge detecting means which detects edges contained in a first image, out of first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter,
a movement detecting means which detects movement of the first and second images,
an edge correcting means which corrects a position of the edges on the basis of the movement, and
a noise reduction means which carries out noise reduction processing on the second image to avoid the edges in a corrected position and obtains a processed image.

### Claim 10 (depends on 9)

An image processing apparatus as defined in claim 9 in which the image data representing the first image comprises RGB data, and the edge detecting means comprises a means for detecting the edges from an image represented at least one of the brightness data and two color difference data generated from the RGB data.

### Claim 11 (depends on 9)

An image processing apparatus as defined in claim 9 in which the first and second images are obtained at the same shutter speed.

### Claim 12 (depends on 9)

An image processing apparatus as defined in claim 9 in which the image data representing the first and second images comprises RGB data, the movement detecting means comprises a means which detects the movement on the basis of the B color data.

### Claim 13 (depends on 1)

An image taking apparatus comprising
an image taking means which obtains an image by photographing,
a filter switching means which moves into and away from the optical axis of the image taking means,
a control means which controls the image taking means and the filter switching means to obtain first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter, and
an image processing apparatus defined in claim 1.

### Claim 14 (depends on 3)

An image taking apparatus comprising
an image taking means which obtains an image by photographing,
a filter switching means which moves into and away from the optical axis of the image taking means,
a control means which controls the image taking means and the filter switching means to obtain first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter, and
an image processing apparatus defined in claim 3.

### Claim 15

(canceled)

### Claim 16

An image processing method comprising the steps of
detecting an edge contained in a first image, out of first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter,
carrying out noise reduction processing on the second image to avoid the edges, and
obtaining a processed image.

### Claim 17

An image processing method comprising the steps of
detecting edges as first and second edge information contained in first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter,
detecting a difference of the images at the corresponding points in the first and second images and
carrying out noise reduction processing on the second image according to the first and second edge information and existence of the difference of the images in the first image, and obtaining a processed image.

### Claim 18

An image processing method comprising the steps of
detecting edges contained in a first image, out of first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter,
detecting movement of the first and second images,
correcting a position of the edges on the basis of the movement, and
carrying out noise reduction processing on the second image to avoid the edges in a corrected position and
obtaining a processed image.

### Claim 19

A computer-readable medium on which is recorded procedure of an image processing method comprising the steps of
detecting an edge contained in a first image, out of first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter,
carrying out noise reduction processing on the second image to avoid the edges, and
obtaining a processed image.

### Claim 20

A computer-readable medium on which is recorded procedure of an image processing method comprising the steps of
detecting edges as first and second edge information contained in first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter,
detecting a difference of the images at the corresponding points in the first and second images and
carrying out noise reduction processing on the second image according to the first and second edge information and existence of the difference of the images in the first image, and obtaining a processed image.

### Claim 21

A computer-readable medium on which is recorded procedure of an image processing method comprising the steps of
detecting edges contained in a first image, out of first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter,
detecting movement of the first and second images,
correcting a position of the edges on the basis of the movement, and
carrying out noise reduction processing on the second image to avoid the edges in a corrected position and
obtaining a processed image.

### Claim 22 (depends on 9)

An image taking apparatus of the present invention comprises an image taking means which obtains an image by photographing,
a filter switching means which moves into and away from the optical axis of the image taking means,
a control means which controls the image taking means and the filter switching means to obtain first and second images representing the same object, one being obtained by photographing without the infrared ray cut filter, the other being obtained by photographing with the infrared ray cut filter, and
an image processing apparatus as defined in claim 9.
