# US 2015/0103216 A1 · Image processing device and method and imaging apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0103216 A1
- Document ID: US20150103216A1
- Status: Published application
- Kind: A1
- Application number: 14/572,881
- Filed: 2014-12-17
- Published: 2015-04-16
- Earliest claimed: 2012-07-06
- Assignees: FUJIFILM Corporation
- Applicants: FUJIFILM Corporation
- Inventors: Hidekazu KURAHASHI
- Web page: https://patentgrep.com/patent/US20150103216A1

## CPC

- H04N 23/843: {Demosaicing, e.g. interpolating colour pixel values}
- H04N 23/63: by using electronic viewfinders
- H04N 23/81: for suppressing or minimising disturbance in the image signal generation
- H04N 25/134: {based on three different wavelength filter elements}
- H04N 25/445: by skipping some contiguous pixels within the read portion of the array
- H04N 25/61: the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
- H04N 25/611: Correction of chromatic aberration
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing device according to the invention includes: a lens information acquisition unit; a color mixture information determination unit; mosaic image acquisition unit that, when the color mixture information determination unit determines that the color mixture information is unidentified, reads, from the color imaging element, a second mosaic image obtained by reducing the number of types of first pixels in the first mosaic image which includes a pixel of a first color formed by at least one color and a pixel of a second color formed by at least one color and in which the number of types of first pixels determined by the arrangement of pixels that are adjacent to a first pixel, which is the pixel of the first color, at a minimum pixel pitch in four directions is equal to or greater than 4; a color mixture correction unit; and a synchronization unit.

## Claims

### Claim 1

An image processing device that generates three-layer color data on the basis of a first mosaic image obtained from a single color imaging element in which color filters are provided in a predetermined color filter arrangement on a plurality of pixels that are two-dimensionally arranged, comprising:
a lens information acquisition unit that acquires information of a lens which is used to capture an image;
a color mixture information determination unit that determines whether color mixture information used for color mixture correction is identified or unidentified on the basis of the lens information;
a mosaic image acquisition unit, when the color mixture information determination unit determines that the color mixture information is unidentified, that reads, from the color imaging element, a second mosaic image obtained by reducing the number of types of first pixels in the first mosaic image which includes a pixel of a first color formed by at least one color and a pixel of a second color formed by at least two colors other than the first color and in which the number of types of first pixels determined by the arrangement of pixels that are adjacent to a first pixel, which is the pixel of the first color, at a minimum pixel pitch in four directions is equal to or greater than 4, and when the color mixture information determination unit determines that the color mixture information is identified, that reads the first mosaic image from the color imaging element;
a color mixture correction unit that performs the color mixture correction for the first mosaic image when the color mixture information determination unit determines that the color mixture information is identified; and
a synchronization unit that generates colors of three layers from the first mosaic image subjected to the color mixture correction or the second mosaic image,
wherein the first color is formed by a color having a higher contribution ratio for obtaining a brightness signal than the second color.

### Claim 2 (depends on 1)

The image processing device according to claim 1,
wherein, when the color mixture information determination unit determines that the color mixture information is identified, the mosaic image acquisition unit reads the first mosaic image from the color imaging element or the mosaic image acquisition unit reads a third mosaic image obtained by reducing the number of types of first pixels from the color imaging element.

### Claim 3

An image processing device that generates three-layer color data on the basis of a first mosaic image obtained from a single color imaging element in which color filters are provided in a predetermined color filter arrangement on a plurality of pixels that are two-dimensionally arranged, comprising:
a lens information acquisition unit that acquires information of a lens which is used to capture an image;
a color mixture information determination unit that determines whether color mixture information used for color mixture correction is identified or unidentified on the basis of the lens information;
a mosaic image acquisition unit that reads the first mosaic image from the color imaging element;
a mosaic image generation unit, when the color mixture information determination unit determines that the color mixture information is unidentified, that generates a second mosaic image obtained by reducing the number of types of first pixels in the first mosaic image which includes a pixel of a first color formed by at least one color and a pixel of a second color formed by at least two colors other than the first color and in which the number of types of first pixels determined by the arrangement of pixels that are adjacent to a first pixel, which is the pixel of the first color, at a minimum pixel pitch in four directions is equal to or greater than 4;
a color mixture correction unit that performs the color mixture correction for the first mosaic image when the color mixture information determination unit determines that the color mixture information is identified; and
a synchronization unit that generates colors of three layers from the first mosaic image subjected to the color mixture correction or the second mosaic image,
wherein the first color is formed by a color having a higher contribution ratio for obtaining a brightness signal than the second color.

### Claim 4 (depends on 3)

The image processing device according to claim 3,
wherein, when the color mixture information determination unit determines that the color mixture information is identified, the mosaic image generation unit generates the first mosaic image or the mosaic image generation unit generates a third mosaic image obtained by reducing the number of types of first pixels.

### Claim 5 (depends on 1)

The image processing device according to claim 1,
wherein the second mosaic image is acquired or generated by reducing the number of types of first pixels in the first mosaic image using an extraction process.

### Claim 6 (depends on 3)

The image processing device according to claim 3,
wherein the second mosaic image is acquired or generated by reducing the number of types of first pixels in the first mosaic image using an extraction process.

### Claim 7 (depends on 5)

The image processing device according to claim 5,
wherein an extraction rate can be changed when the number of types of first pixels is reduced by the extraction process.

### Claim 8 (depends on 6)

The image processing device according to claim 6,
wherein an extraction rate can be changed when the number of types of first pixels is reduced by the extraction process.

### Claim 9 (depends on 1)

The image processing device according to claim 1,
wherein, in the second mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction, and
the first pixels are arranged on a straight line extending in the first direction.

### Claim 10 (depends on 3)

The image processing device according to claim 3,
wherein, in the second mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction, and
the first pixels are arranged on a straight line extending in the first direction.

### Claim 11 (depends on 1)

The image processing device according to claim 1,
wherein, in the second mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction,
the first pixels are arranged on the straight line extending in the first direction, and
the first pixel and a second pixel, which is the pixel of the second color, are arranged on a straight line extending in the second direction.

### Claim 12 (depends on 3)

The image processing device according to claim 3,
wherein, in the second mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction,
the first pixels are arranged on the straight line extending in the first direction, and
the first pixel and a second pixel, which is the pixel of the second color, are arranged on a straight line extending in the second direction.

### Claim 13 (depends on 2)

The image processing device according to claim 2,
wherein, in the third mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction, and
the first pixels are arranged on a straight line extending in the first direction.

### Claim 14 (depends on 4)

The image processing device according to claim 4,
wherein, in the third mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction, and
the first pixels are arranged on a straight line extending in the first direction.

### Claim 15 (depends on 2)

The image processing device according to claim 2,
wherein, in the third mosaic image, the types of first pixels have regularity or a single type of the first pixels is arranged in a first direction and a second direction perpendicular to the first direction,
the first pixels are arranged on a straight line extending in the first direction, and
the first pixel and a second pixel, which is the pixel of the second color, are arranged on a straight line extending in the second direction.

### Claim 16 (depends on 1)

The image processing device according to claim 1,
wherein the type of first pixel is determined by the arrangement of the pixels which are adjacent to the first pixel at the minimum pixel pitch in the four directions and a base structure of the imaging element.

### Claim 17 (depends on 1)

The image processing device according to claim 1,
wherein the second mosaic image includes two types of first pixels.

### Claim 18 (depends on 1)

An imaging apparatus comprising:
the image processing device according to claim 1; and
an imaging unit including an imaging optical system of a lens interchangeable type and an imaging element on which an object image is formed through the imaging optical system.

### Claim 19 (depends on 1)

An image processing method using the imaging device according to claim 1 that generates three-layer color data on the basis of a first mosaic image obtained from a single color imaging element in which color filters are provided in a predetermined color filter arrangement on a plurality of pixels that are two-dimensionally arranged, comprising:
a lens information acquisition step of acquiring information of a lens which is used to capture an image;
a color mixture information determination step of determining whether color mixture information used for color mixture correction is identified or unidentified on the basis of the lens information;
a mosaic image acquisition step of, when the color mixture information is determined to be unidentified in the color mixture information determination step, reading, from the color imaging element, a second mosaic image obtained by reducing the number of types of first pixels in the first mosaic image which includes a pixel of a first color formed by at least one color and a pixel of a second color formed by at least two colors other than the first color and in which the number of types of first pixels determined by the arrangement of pixels that are adjacent to a first pixel, which is the pixel of the first color, at a minimum pixel pitch in four directions is equal to or greater than 4, and when the color mixture information is determined to be identified in the color mixture information determination step, reading the first mosaic image from the color imaging element;
a color mixture correction step of performing the color mixture correction for the first mosaic image when the color mixture information is determined to be identified in the color mixture information determination step; and
a synchronization step of generating colors of three layers from the first mosaic image subjected to the color mixture correction or the second mosaic image,
wherein the first color is formed by a color having a higher contribution ratio for obtaining a brightness signal than the second color.

### Claim 20 (depends on 3)

An image processing method using the image processing device according to claim 3 that generates three-layer color data on the basis of a first mosaic image obtained from a single color imaging element in which color filters are provided in a predetermined color filter arrangement on a plurality of pixels that are two-dimensionally arranged, comprising:
a lens information acquisition step of acquiring information of a lens which is used to capture an image;
a color mixture information determination step of determining whether color mixture information used for color mixture correction is identified or unidentified on the basis of the lens information;
a mosaic image acquisition step of reading the first mosaic image from the color imaging element;
a mosaic image generation step of, when the color mixture information is determined to be unidentified in the color mixture information determination step, generating a second mosaic image obtained by reducing the number of types of first pixels in the first mosaic image which includes a pixel of a first color formed by at least one color and a pixel of a second color formed by at least two colors other than the first color and in which the number of types of first pixels determined by the arrangement of pixels that are adjacent to a first pixel, which is the pixel of the first color, at a minimum pixel pitch in four directions is equal to or greater than 4;
a color mixture correction step of performing the color mixture correction for the first mosaic image when the color mixture information is determined to be identified in the color mixture information determination step; and
a synchronization step of generating colors of three layers from the first mosaic image subjected to the color mixture correction or the second mosaic image,
wherein the first color is formed by a color having a higher contribution ratio for obtaining a brightness signal than the second color.
