# US 2018/0027195 A1 · Image processing apparatus and a control method for controlling the image processing apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0027195 A1
- Document ID: US20180027195A1
- Status: Published application
- Kind: A1
- Application number: 15/653,074
- Filed: 2017-07-18
- Published: 2018-01-25
- Earliest claimed: 2016-07-21
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Yohei Yamanaka
- Web page: https://patentgrep.com/patent/US20180027195A1

## CPC

- H04N 25/626: Reduction of noise due to residual charges remaining after image readout, e.g. to remove ghost images or afterimages
- G06T 3/4015: Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
- H04N 13/218: using spatial multiplexing
- H04N 13/232: using fly-eye lenses, e.g. arrangements of circular lenses
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- H04N 25/41: {Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors}
- H04N 25/615: involving a transfer function modelling the optical system, e.g. optical transfer function [OTF], phase transfer function [PhTF] or modulation transfer function [MTF]
- H04N 23/843: {Demosaicing, e.g. interpolating colour pixel values}
- H04N 2013/0088: {Synthesising a monoscopic image signal from stereoscopic images, e.g. synthesising a panoramic or high resolution monoscopic image}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing apparatus includes an image obtaining unit configured to obtain a plurality of viewpoint images, a detecting unit configured to detect a first undesirable component of the viewpoint images according to relative difference information that is a difference between the viewpoint images, a noise information obtaining unit configured to obtain noise information of the viewpoint images, a calculation unit configured to calculate a second undesirable component by subtracting noise from the first undesirable component according to the first undesirable component and the noise information, and a reducing unit configured to reduce the second undesirable component of an image formed based on the viewpoint images.

## Claims

### Claim 1

An image processing apparatus comprising:
one or more processors; and
a memory storing instructions which, when executed by the one or more processors, cause the image processing apparatus to function as:
a first obtaining unit configured to obtain a plurality of viewpoint images;
a detecting unit configured to detect a first undesirable component of the viewpoint images according to relative difference information that is a difference between the viewpoint images;
a second obtaining unit configured to obtain noise information of the viewpoint images;
a calculation unit configured to calculate a second undesirable component by subtracting noise from the first undesirable component according to the first undesirable component and the noise information; and
a reducing unit configured to reduce the second undesirable component of an image formed based on the viewpoint images.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein the reducing unit reduces the second undesirable component of a composite image of the viewpoint images.

### Claim 3 (depends on 2)

The image processing apparatus according to claim 2, wherein the detecting unit detects the first undesirable component of each of the viewpoint images and calculates a composite value of the first undesirable components of the viewpoint images.

### Claim 4 (depends on 1)

The image processing apparatus according to claim 1, wherein the noise information is calculated based on undesirable components of the viewpoint images previously captured and measured by an image capture element.

### Claim 5 (depends on 1)

The image processing apparatus according to claim 1, further comprising:
an image processing unit configured to perform a noise reduction process for reducing noise of the image processed by the reducing unit.

### Claim 6 (depends on 5)

The image processing apparatus according to claim 5, wherein the image processing unit performs image processing including a demosaicing process in addition to the noise reduction process.

### Claim 7 (depends on 1)

The image processing apparatus according to claim 1, wherein the viewpoint image is divided into a plurality of regions, and the noise information is calculated based on a standard deviation of the regions.

### Claim 8 (depends on 1)

The image processing apparatus according to claim 1, wherein the noise information is calculated based on a standard deviation of undesirable components of the viewpoint images previously captured and measured by an image capture element.

### Claim 9

An image processing apparatus comprising:
an obtaining unit configured to obtain a plurality of viewpoint images;
a reducing unit configured to reduce a noise component of each of the viewpoint images;
a detecting unit configured to detect an undesirable component of the viewpoint images according to relative difference information between the viewpoint images; and
a reducing unit configured to reduce the undesirable component of an image formed based on the viewpoint images.

### Claim 10 (depends on 9)

The image processing apparatus according to claim 9, wherein the reducing unit reduces the undesirable component of a composite image of the viewpoint images.

### Claim 11 (depends on 9)

The image processing apparatus according to claim 9, wherein the detecting unit detects the undesirable component of each of the viewpoint images and calculates a composite value of the undesirable components of the viewpoint images.

### Claim 12 (depends on 9)

The image processing apparatus according to claim 9, further comprising:
an image processing unit configured to perform a noise reduction process for reducing noise of the image processed by the reducing unit.

### Claim 13 (depends on 12)

The image processing apparatus according to claim 12, wherein the image processing unit performs image processing including a demosaicing process in addition to the noise reduction process.

### Claim 14

A control method for controlling an image processing apparatus, the method comprising:
obtaining a plurality of viewpoint images;
detecting a first undesirable component of the viewpoint images according to relative difference information that is a difference between the viewpoint images;
obtaining noise information of the viewpoint images;
calculating a second undesirable component by subtracting noise from the first undesirable component according to the first undesirable component and the noise information; and
reducing the second undesirable component of an image formed based on the viewpoint images.

### Claim 15

A control method for controlling an image processing apparatus, the method comprising:
obtaining a plurality of viewpoint images;
reducing a noise component of each of the viewpoint images;
detecting an undesirable component of the viewpoint images according to relative difference information between the viewpoint images; and
reducing the undesirable component of an image formed based on the viewpoint images.

### Claim 16

A non-transitory computer readable storage medium storing a program for causing a computer to perform procedures of a control method for controlling an image processing apparatus, the procedures comprising:
obtaining a plurality of viewpoint images;
reducing a noise component of each of the viewpoint images;
detecting an undesirable component of the viewpoint images according to relative difference information between the viewpoint images; and
reducing the undesirable component of an image formed based on the viewpoint images.
