# US 2019/0378259 A1 · Image processing system, image processing device, image processing method, and image processing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378259 A1
- Document ID: US20190378259A1
- Status: Published application
- Kind: A1
- Application number: 16/550,800
- Filed: 2019-08-26
- Published: 2019-12-12
- Earliest claimed: 2017-03-10
- Assignees: FUJIFILM Corporation
- Applicants: FUJIFILM Corporation
- Inventors: Kenkichi HAYASHI; Yosuke NARUSE; Yasunobu KISHINE
- Web page: https://patentgrep.com/patent/US20190378259A1

## CPC

- G01N 21/8851: {Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges (G01N21/8806 and G01N21/93 - G01N21/95692 take precedence; optical measurement of dimensions G01B11/00; optical scanning G02B26/10; image transformation G06T3/00; computerised image enhancement G06T5/00; image processing per se for flaw detection G06T7/0002)}
- G01B 11/022: {by means of tv-camera scanning}
- G01B 11/245: using a plurality of fixed, simultaneously operating transducers ({G01B11/2408 - G01B11/2425, } G01B11/255 take precedence)
- G01B 21/045: {Correction of measurements (G01B9/02055 takes precedence)}
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/80: Geometric correction
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- H04N 23/60: Control of cameras or camera modules
- G01N 2021/8887: {based on image processing techniques}
- G06T 2207/30168: Image quality inspection
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Provided are an image-processing system, an image-processing device, an image-processing method, and an image-processing program capable of appropriately inspecting, measuring, or recognizing targets by using a plurality of imaging units even in a case where there is an individual difference in performance of each imaging unit. An image correction-processing unit that individually acquires pieces of image data from a first camera and a second camera to individually correct image deterioration caused by each of the cameras by pieces of image-processing and an inspection processing unit that individually acquires the pieces of image data after the correction from the image correction-processing unit to individually inspect imaged targets by pieces of image-processing are provided. In a case where the first camera and the second camera image the same targets, the image correction-processing unit individually corrects the image data acquired from each camera such that inspection results match within a desired range.

## Claims

### Claim 1

An image processing system comprising:
a plurality of imaging units;
a first image processing unit that individually acquires pieces of image data from the plurality of imaging units to individually correct image deterioration caused by each of the imaging units by pieces of image processing; and
a second image processing unit that individually acquires the pieces of image data after the correction from the first image processing unit to individually inspect, measure, or recognize imaged targets by pieces of image processing,
wherein in a case where the plurality of imaging units individually image a plurality of substantially the same targets that have same shapes and/or same appearances, the first image processing unit individually corrects the pieces of image data acquired from the plurality of imaging units such that results of the second image processing unit match within a desired range.

### Claim 2 (depends on 1)

The image processing system according to claim 1, further comprising:
a third image processing unit that individually acquires the pieces of image data from the plurality of imaging units to individually correct and uniformize a variation in image quality occurring due to a difference in an imaging environment by pieces of image processing,
wherein the first image processing unit individually acquires the pieces of image data after the correction from the third image processing unit to individually correct image deterioration caused by each of the imaging units by pieces of image processing.

### Claim 3 (depends on 1)

The image processing system according to claim 1,
wherein the first image processing unit individually corrects image deterioration caused by an optical system provided in each of the imaging units by pieces of image processing.

### Claim 4 (depends on 2)

The image processing system according to claim 2,
wherein the first image processing unit individually corrects image deterioration caused by an optical system provided in each of the imaging units by pieces of image processing.

### Claim 5 (depends on 1)

The image processing system according to claim 1, further comprising:
a parameter setting unit that sets a parameter of the image processing performed by the first image processing unit,
wherein the parameter setting unit sets the parameter based on the results of the inspection, the measurement, or the recognition by the second image processing unit.

### Claim 6 (depends on 2)

The image processing system according to claim 2, further comprising:
a parameter setting unit that sets a parameter of the image processing performed by the first image processing unit,
wherein the parameter setting unit sets the parameter based on the results of the inspection, the measurement, or the recognition by the second image processing unit.

### Claim 7 (depends on 5)

The image processing system according to claim 5,
wherein the parameter setting unit optimizes the parameter based on a change in the results of the second image processing unit in a case where the parameter is changed.

### Claim 8 (depends on 5)

The image processing system according to claim 5,
wherein the parameter setting unit optimizes the parameter by a gradient method.

### Claim 9

An image processing device comprising:
a first image processing unit that individually acquires pieces of image data from a plurality of imaging units to individually correct image deterioration caused by each of the imaging units by pieces of image processing; and
a second image processing unit that individually acquires the pieces of image data after the correction from the first image processing unit to individually inspect, measure, or recognize imaged targets by pieces of image processing,
wherein in a case where the plurality of imaging units individually image a plurality of substantially the same targets that have same shapes and/or same appearances, the first image processing unit individually corrects the pieces of image data acquired from the plurality of imaging units such that results of the second image processing unit match within a desired range.

### Claim 10 (depends on 9)

The image processing device according to claim 9, further comprising:
a third image processing unit that individually acquires the pieces of image data from the plurality of imaging units to individually correct and uniformize a variation in image quality occurring due to a difference in an imaging environment by pieces of image processing,
wherein the first image processing unit individually acquires the pieces of image data after the correction from the third image processing unit to individually correct image deterioration caused by each of the imaging units by pieces of image processing.

### Claim 11 (depends on 9)

The image processing device according to claim 9,
wherein the first image processing unit individually corrects image deterioration caused by an optical system provided in each of the imaging units by pieces of image processing.

### Claim 12 (depends on 9)

The image processing device according to claim 9, further comprising:
a parameter setting unit that sets a parameter of the image processing performed by the first image processing unit,
wherein the parameter setting unit sets the parameter based on the results of the inspection, the measurement, or the recognition by the second image processing unit.

### Claim 13

An image processing method comprising:
a first image processing step of individually acquiring pieces of image data from a plurality of imaging units to individually correct image deterioration caused by each of the imaging units by pieces of image processing; and
a second image processing step of individually acquiring the pieces of image data after the correction in the first image processing step to individually inspect, measure, or recognize imaged targets by pieces of image processing,
wherein in a case where the plurality of imaging units individually image a plurality of substantially the same targets that have same shapes and/or same appearances, the first image processing step individually corrects the pieces of image data acquired from the plurality of imaging units such that results of the inspection, the measurement, or the recognition in the second image processing step match within a desired range.

### Claim 14 (depends on 13)

The image processing method according to claim 13, further comprising:
a third image processing step of individually acquiring the pieces of image data from the plurality of imaging units to individually correct and uniformize a variation in image quality occurring due to a difference in an imaging environment by pieces of image processing,
wherein the first image processing step is executed after the third image processing step.

### Claim 15 (depends on 13)

The image processing method according to claim 13, further comprising:
a parameter setting step of setting a parameter of the image processing performed by the first image processing step,
wherein in the parameter setting step, the parameter is set based on the results of the inspection, the measurement, or the recognition in the second image processing step.

### Claim 16 (depends on 13)

The image processing method according to claim 13,
wherein in the first image processing step, image deterioration caused by an optical system provided in each of the imaging units is individually corrected by pieces of image processing.

### Claim 17

A non-transitory computer readable recording medium storing an image processing program causing a computer to realize:
a first image processing function of individually acquiring pieces of image data from a plurality of imaging units to individually correct image deterioration caused by each of the imaging units by pieces of image processing; and
a second image processing function of individually acquiring the pieces of image data after the correction by the first image processing function to individually inspect, measure, or recognize imaged targets by pieces of image processing,
wherein in the case where the plurality of imaging units individually image a plurality of substantially the same targets that have same shapes and/or same appearances, the first image processing function individually corrects the pieces of image data acquired from the plurality of imaging units such that results of the inspection, the measurement, or the recognition by the second image processing function match within a desired range.

### Claim 18 (depends on 17)

The non-transitory computer readable recording medium storing the image processing program according to claim 17, further comprising:
a third image processing function of individually acquiring the pieces of image data from the plurality of imaging units to individually correct and uniformize a variation in image quality occurring due to a difference in an imaging environment by pieces of image processing,
wherein the first image processing function individually acquires the pieces of image data after the correction from the third image processing function to individually correct image deterioration caused by each of the imaging units by pieces of image processing.

### Claim 19 (depends on 17)

The non-transitory computer readable recording medium storing the image processing program according to claim 17, further comprising:
a parameter setting function of setting a parameter of the image processing performed by the first image processing function,
wherein the parameter setting function sets the parameter based on the results of the inspection, the measurement, or the recognition by the second image processing function.

### Claim 20 (depends on 17)

The non-transitory computer readable recording medium storing the image processing program according to claim 17,
wherein the first image processing function individually corrects image deterioration caused by an optical system provided in each of the imaging units by pieces of image processing.
