# US 9,872,610 B2 · Image processing device, imaging device, computer-readable storage medium, and image processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,872,610 B2
- Document ID: US9872610B2
- Status: Granted
- Kind: B2
- Application number: 14/790,308
- Filed: 2015-07-02
- Published: 2015-10-22
- Granted: 2018-01-23
- Earliest claimed: 2009-03-26
- Assignees: Olympus Corporation
- Applicants: Olympus Corporation
- Inventors: Keiji Higuchi
- Web page: https://patentgrep.com/patent/US9872610B2

## CPC

- A61B 1/043: {for fluorescence imaging}
- A61B 1/00096: {Optical elements}
- A61B 1/0051: {with controlled bending of insertion part}
- A61B 1/05: characterised by the image sensor, e.g. camera, being in the distal end portion
- A61B 1/0638: {providing two or more wavelengths}
- A61B 1/0646: {with illumination filters}
- A61B 1/0655: {Control therefor}
- H04N 23/74: by influencing the scene brightness using illuminating means
- H04N 23/555: {for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A reflected light image and a fluorescent light image of an observed region are acquired with an imaging system. A gradation level of the reflected light image is set on the basis of a feature value of the acquired reflected light image. The focus of the imaging system is controlled in accordance with the set gradation level. The fluorescent light image is corrected using a focus-controlled reflected light image of the observed region. Accordingly, the image of an object in the observed region from which the fluorescent light is generated is sharpened.

## Claims

### Claim 1

An image processing method, comprising:
acquiring a reflected light image of an observed region based on light that is reflected from the observed region;
calculating a feature value of the reflected light image;
setting an amount of shift of focus of the reflected light image on the basis of the feature value;
controlling a focus of an imaging system for the reflected light image in accordance with the amount of shift of focus;
acquiring a focus-controlled reflected light image of the observed region when the focus is controlled to be in an unfocused state; and
generating a corrected fluorescent light image that is obtained by correcting a fluorescent light image of the observed region, using the focus-controlled reflected light image that is in the unfocused state;
wherein the focus of the imaging system is controlled so that the focus-controlled reflected light image arrives at the unfocused state in the observed region in accordance with the amount of shift of focus.

### Claim 2 (depends on 1)

The image processing method according to claim 1, wherein
as the feature value of the reflected light image, at least one of edge information of the reflected light image, a dispersion of a predetermined color component that is contained in the reflected light image, and a peak-to-peak difference of a color distribution of the reflected light image is calculated, and
after the focus of the imaging system is controlled in accordance with the amount of shift of focus, the focus-controlled reflected light image of the observed region is acquired.

### Claim 3 (depends on 1)

The image processing method according to claim 1, wherein division regarding the fluorescent light image is performed using the focus-controlled reflected light image of the observed region, in order to generate the corrected fluorescent light image that is obtained by correcting a luminance value of the fluorescent light image.

### Claim 4 (depends on 1)

The image processing method according to claim 1, wherein
the feature value includes edge information of the reflected light image, and
the amount of shift of focus of the reflected light image is increased with an increase of the edge information, and the amount of shift of focus of the reflected light image is reduced with a decrease of the edge information.

### Claim 5 (depends on 1)

The image processing method according to claim 1, wherein
the feature value includes a dispersion of a predetermined color component that is contained in the reflected light image, and
the amount of shift of focus of the reflected light image is increased with an increase of the dispersion of the predetermined color component, and the amount of shift of focus of the reflected light image is reduced with a decrease of the dispersion of the predetermined color component.

### Claim 6 (depends on 1)

The image processing method according to claim 1, wherein
the feature value includes a peak-to-peak difference of a color distribution of the reflected light image, and
the amount of shift of focus of the reflected light image is increased with an increase of the peak-to-peak difference of the color distribution, and the amount of shift of focus of the reflected light image is reduced with a decrease of the peak-to-peak difference of the color distribution.

### Claim 7 (depends on 1)

The image processing method according to claim 1, wherein
the reflected light image and the fluorescent light image are sequentially captured by the imaging system, with the focus being on the observed region, and
the focus-controlled reflected light image is captured after the focus is controlled in accordance with the amount of shift of focus.