# US 2019/0296062 A1 · Image capturing device, image capturing method, image processing device, image processing method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0296062 A1
- Document ID: US20190296062A1
- Status: Published application
- Kind: A1
- Application number: 16/356,222
- Filed: 2019-03-18
- Published: 2019-09-26
- Earliest claimed: 2018-03-22
- Assignees: Ricoh Company, Ltd.
- Inventors: Masakazu TERAUCHI; Hiroyasu UEHARA
- Web page: https://patentgrep.com/patent/US20190296062A1

## CPC

- G06T 3/4015: Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
- H10F 39/8023: {Disposition of the elements in pixels, e.g. smaller elements in the centre of the imager compared to larger elements at the periphery}
- G06F 9/30003: {Arrangements for executing specific machine instructions}
- H04N 23/843: {Demosaicing, e.g. interpolating colour pixel values}
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- H04N 25/48: Increasing resolution by shifting the sensor relative to the scene
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H10F: INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

There is provided an image capturing device including: an inputter configured to receive first image data and second image data; a pixel determiner configured to determine a second pixel included in the second image data and corresponding to a first pixel included in the first image data; and a corrector configured to correct a value of the first pixel with a value of the second pixel.

## Claims

### Claim 1

An image capturing device comprising circuitry configured to:
receive first image data and second image data;
determine a second pixel included in the second image data and corresponding to a first pixel included in the first image data; and
correct a value of the first pixel with a value of the second pixel.

### Claim 2 (depends on 1)

The image capturing device according to claim 1, wherein
the circuitry is further configured to:
calculate an amount of position displacement between the first image data and the second image data; and
obtain at least one of the value of the second pixel in the second image data and a correction value based on the second pixel based on the amount of position displacement and position information about the first pixel in the first image data.

### Claim 3 (depends on 2)

The image capturing device according to claim 2, wherein
the circuitry is further configured to:
match a pixel position in the first image data with a pixel position in the second image data in accordance with the amount of position displacement;
to set a pixel of interest at a position common between the first image data and the second image data;
obtain, in a case where the pixel of interest in the first image data is the first pixel, at least one of the value of the second pixel in the second image data and the correction value based on the second pixel, based on at least one of the pixel of interest in the second image data and a pixel other than the pixel of interest in the second image data; and
correct the first pixel with at least one of the value of the second pixel and the correction value.

### Claim 4 (depends on 3)

The image capturing device according to claim 3, wherein
in a case where the pixel of interest in the first image data is the first pixel, the circuitry is configured to extract the pixel of interest in the second image data as at least one of the value of the second pixel and the correction value.

### Claim 5 (depends on 3)

The image capturing device according to claim 3, wherein
in a case where the pixel of interest in the first image data is the first pixel, the circuitry is configured to calculate at least one of the value of the second pixel and the correction value on the basis of a group of pixels adjacent to the pixel of interest in the second image data.

### Claim 6 (depends on 1)

The image capturing device according to claim 1, wherein
the circuitry is further configured to:
obtain the first image data and the second image data while moving an image sensing surface of an image sensor element relative to a light flux from an object by a pixel unit; and
control a size of the pixel unit so that, in the first image data and the second image data, a plurality of defective pixels including a reference pixel are not present in a referenced region that is located around the reference pixel.

### Claim 7 (depends on 6)

The image capturing device according to claim 6, wherein
the circuitry is further configured to:
perform, in a case where an image surface phase difference correction pixel corresponding to one color of red, green, and blue colors is set in at least one of the first image data and the second image data and where another pixel of the same color is moved to an original position of the image surface phase difference correction pixel, replacement with the other pixel.

### Claim 8 (depends on 1)

The image capturing device according to claim 1, wherein
the first image data and the second image data are output from the same image sensor element.

### Claim 9 (depends on 1)

The image capturing device according to claim 1, wherein
the first image data and the second image data have different image position relationships.

### Claim 10 (depends on 1)

The image capturing device according to claim 1, wherein
the circuitry is further configured to combine the first image data and the second image data to obtain combined image data.

### Claim 11

An image capturing method comprising:
receiving first image data and second image data;
determining a second pixel included in the second image data and corresponding to a first pixel included in the first image data; and
correcting a value of the first pixel with a value of the second pixel.

### Claim 12

A non-transitory recording medium storing a plurality of instructions which, when executed by one or more processors, cause the processors to perform an image capturing method, comprising:
receiving first image data and second image data;
determining a second pixel included in the second image data and corresponding to a first pixel included in the first image data; and
correcting a value of the first pixel with a value of the second pixel.

### Claim 13

An image processing device comprising circuitry configured to:
receive first image data and second image data;
determine a second pixel included in the second image data and corresponding to a first pixel included in the first image data; and
correct a value of the first pixel with a value of the second pixel.

### Claim 14

An image processing device comprising circuitry configured to:
detect an amount of position displacement between pieces of image data;
select correction target image data and correction image data in accordance with the amount of position displacement; and
change a defective pixel in the correction target image data on the basis of the amount of position displacement and the correction image data, wherein
the correction target image data and the correction image data are combined based on the amount of position displacement.

### Claim 15

An image processing device comprising circuitry configured to:
detect an amount of position displacement between pieces of image data;
select a reference image and a combination target image from among a plurality of images in accordance with the amount of position displacement,
assume the reference image or the combination target image that includes a defective pixel to be correction target image data;
select correction image data from among the plurality of images in accordance with the correction target image data and the amount of position displacement; and
change the defective pixel in the correction target image data on the basis of the amount of position displacement and the correction image data, wherein
the reference image and the combination target image are combined on the basis of the amount of position displacement.

### Claim 16

An image processing method comprising:
receiving first image data and second image data;
determining a second pixel included in the second image data and corresponding to a first pixel included in the first image data; and
correcting a value of the first pixel with a value of the second pixel.

### Claim 17

A non-transitory recording medium storing a plurality of instructions which, when executed by one or more processors, cause the processors to perform an image processing method, comprising:
receiving first image data and second image data;
determining a second pixel included in the second image data and corresponding to a first pixel included in the first image data; and
correcting a value of the first pixel with a value of the second pixel.
