# US 2019/0295219 A1 · Image processing device, microscope system, image processing method, and computer program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0295219 A1
- Document ID: US20190295219A1
- Status: Published application
- Kind: A1
- Application number: 16/464,079
- Filed: 2016-11-24
- Published: 2019-09-26
- Earliest claimed: 2016-11-24
- Assignees: Nikon Corporation
- Applicants: Nikon Corporation
- Inventors: Yutaka SASAKI; Toshiya OKABE; Ichiro SASE; Ryosuke KOMATSU; Johana TROJANOVA; Miroslav SVOBODA
- Web page: https://patentgrep.com/patent/US20190295219A1

## CPC

- G02B 21/365: {Control or image processing arrangements for digital or video microscopes (G02B21/361, G02B21/362 take precedence)}
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- A61B 6/03: Computed tomography [CT]
- G02B 21/00: Microscopes
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06T 1/00: General purpose image data processing
- G06T 5/92: based on global image properties
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10056: Microscopic image
- G06T 2207/20208: High dynamic range [HDR] image processing
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processor having: an accepting unit that accepts designation of at least part of three dimensional microscope image data, and an image generator that generates three dimensional magnified image data based on the designation. In the image processor, the image generator may sequentially output a first magnified image based on at least a part of data of the three dimensional magnified image data and a second magnified image based on at least a part of data of the three dimensional magnified image data in which at least a part of data is different from the data of the first magnified image.

## Claims

### Claim 1

An image processor, comprising:
an accepting unit that accepts designation of at least a part of three dimensional microscope image data; and
an image generator that generates three dimensional magnified image data based on the designation.

### Claim 2 (depends on 1)

The image processor according to claim 1, wherein
the image generator sequentially outputs a first magnified image based on at least a part of data of the three dimensional magnified image data and a second magnified image based on at least a part of data of the three dimensional magnified image data in which at least a part of data is different from the data of the first magnified image.

### Claim 3 (depends on 2)

The image processor according to claim 2, wherein
the image generator generates a first image based on at least a part of data of the three dimensional microscope image data and a second image based on at least a part of data of the three dimensional microscope image data in which at least a part of data is different from the data of the first image, and
the image generator sequentially outputs an image in which the first magnified image and the first image are superimposed and an image in which the second magnified image and the second image are superimposed.

### Claim 4 (depends on 1)

The image processor according to claim 1, wherein
the image generator superimposes and outputs a magnified image based on at least a part of data of the three dimensional magnified image data and an image based on at least a part of data of the three dimensional microscope image data.

### Claim 5 (depends on 1)

The image processor according to claim 1, wherein
the image generator outputs a microscope image based on at least a part of data of the three dimensional microscope image data, and
the accepting unit accepts designation of a position in at least a part of the microscope image.

### Claim 6 (depends on 5)

The image processor according to claim 5, wherein
the three dimensional microscope image data includes image data regarding a three dimensional microscope image,
the microscope image includes microscope images, based on the three dimensional microscope image data, of at least two planes which are not parallel to each other in the three dimensional microscope image three dimensional, and
the accepting unit accepts designation of a position in at least a part of each of the microscope images of the two planes.

### Claim 7 (depends on 5)

The image processor according to claim 5, wherein
the three dimensional microscope image data includes image data regarding a three dimensional microscope image,
the microscope image includes microscope images, based on the three dimensional microscope image data, of a plurality planes which are parallel to each other in the three dimensional microscope image three dimensional, and
the accepting unit accepts selection of a particular microscope image from the microscope images of a plurality planes and accepts designation of a position in at least a part of the particular microscope image.

### Claim 8 (depends on 5)

The image processor according to claim 5, wherein
the microscope image includes a three dimensional microscope image based on the three dimensional microscope image data, and
the accepting unit accepts designation of a position in at least a part of the three dimensional microscope image.

### Claim 9 (depends on 5)

The image processor according to claim 5, wherein
the three dimensional microscope image data includes image data regarding a three dimensional microscope image,
the image includes a projection image, based on the three dimensional microscope image data, obtained by projecting the three dimensional microscope image three dimensional an arbitrary plane, and
the accepting unit accepts designation of a position in at least a part of the projection image.

### Claim 10 (depends on 1)

The image processor according to claim 1, wherein
the image generator outputs a reference image,
the accepting unit accepts designation of a position in at least a part of the reference image, and
the image generator generates the three dimensional magnified image data based on at least a part of data of the three dimensional microscope image data corresponding to the designated position in at least a part of the reference image.

### Claim 11 (depends on 1)

The image processor according to claim 1, wherein
the three dimensional microscope image data includes image data regarding a three dimensional microscope image, and
the image generator outputs a position reference image indicating a position in the three dimensional microscope image corresponding to at least a part of the three dimensional microscope image data, the designation of the three dimensional microscope image being accepted by the accepting unit.

### Claim 12 (depends on 1)

The image processor according to claim 1, wherein
the image generator outputs a magnified image based on at least a part of the three dimensional magnified image data, and
display conditions of the magnified image vary between a first region including a center of the magnified image and a second region outside the first region.

### Claim 13 (depends on 1)

The image processor according to claim 1, wherein
the image generator outputs a magnified image based on at least a part of the three dimensional magnified image data,
the accepting unit accepts input of information regarding a route for outputting the magnified image, and
the image generator sequentially outputs the magnified image based on the information regarding the route.

### Claim 14 (depends on 1)

The image processor according to claim 1, wherein
the image generator outputs a magnified image based on at least a part of the three dimensional magnified image data,
the accepting unit accepts input of a threshold regarding pixel value of the magnified image, and
the image generator outputs a magnified image to be displayed under different display condition based on the threshold.

### Claim 15 (depends on 1)

The image processor according to claim 1, wherein
the image generator generates a second three dimensional magnified image data based on at least a part of data corresponding to at least a part of the three dimensional microscope image data, the designation of which is accepted, in the second three dimensional microscope image data.

### Claim 16 (depends on 1)

A microscope system, comprising:
an image processor according to claim 1;
a microscope configured to output microscope image data to the image processor; and
a display configured to display an image output from the image processor.

### Claim 17

An image processing method, comprising:
accepting designation of at least a part of three dimensional microscope image data; and
generating three dimensional magnified image data based on the designation.

### Claim 18 (depends on 17)

The image processing method according to claim 17, wherein
generating the three dimensional magnified image data includes sequentially outputting a first magnified image based on at least a part of data of the three dimensional magnified image data and a second magnified image based on at least a part of data of the three dimensional magnified image data in which at least a part of data is different from the data of the first magnified image.

### Claim 19 (depends on 18)

The image processing method according to claim 18, wherein
generating the three dimensional magnified image data includes: generating a first image based on at least a part of data of the three dimensional microscope image data and a second image based on at least a part of data of the three dimensional microscope image data in which at least a part of data is different from the data of the first image; and
sequentially outputting an image in which the first magnified image and the first image are superimposed and an image in which the second magnified image and the second image are superimposed.

### Claim 20 (depends on 17)

The image processing method according to claim 17, wherein
generating the three dimensional magnified image data includes superimposing a magnified image based on at least a part of data of the three dimensional magnified image data and an image based on at least a part of data of the three dimensional microscope image data and outputting the superimposed image.

### Claim 21 (depends on 17)

The image processing method according to claim 17, further comprising:
outputting a microscope image based on at least a part of data of the three dimensional microscope image data, wherein
accepting the designation includes accepting designation of a position in at least a part of the microscope image.

### Claim 22 (depends on 21)

The image processing method according to claim 21, wherein
the three dimensional microscope image data includes image data regarding a three dimensional microscope image,
the microscope image includes microscope images of at least two planes which are not parallel to each other in the three dimensional microscope image based on the three dimensional microscope image data, and
accepting the designation includes accepting designation of a position in at least a part of each of the microscope images of the two planes.

### Claim 23 (depends on 21)

The image processing method according to claim 21, wherein
the three dimensional microscope image data includes image data regarding a three dimensional microscope image,
the microscope image includes microscope images of a plurality of planes which are parallel to each other in the three dimensional microscope image based on the three dimensional microscope image data, and
accepting the designation includes accepting selection of a particular microscope image from the microscope images of a plurality of planes and accepting designation of a position in at least a part of the particular microscope image.

### Claim 24 (depends on 21)

The image processing method according to claim 21, wherein
the microscope image includes a three dimensional microscope image based on the three dimensional microscope image data, and
accepting the designation includes accepting designation of the position in at least a part of the three dimensional microscope image.

### Claim 25 (depends on 21)

The image processing method according to claim 21, wherein
the three dimensional microscope image data includes image data regarding a three dimensional microscope image,
the image includes a projection image obtained by projecting the three dimensional microscope image based on the three dimensional microscope image data on an arbitrary plane, and
accepting the designation includes accepting designation of a position in at least a part of the projection image.

### Claim 26 (depends on 17)

The image processing method according to claim 17, further comprising: outputting a reference image, wherein
accepting the designation includes accepting designation of a position in at least a part of the reference image, and
generating the three dimensional magnified image data includes generating the three dimensional magnified image data based on at least a part of data of the three dimensional microscope image data corresponding to the designated position in at least a part of the reference image.

### Claim 27

A non-transitory computer readable medium storing computer program configured to cause a computer to execute:
accepting designation of at least a part of three dimensional microscope image data; and
generating three dimensional magnified image data based on the designation.
