# US 2018/0322329 A1 · Image processing device, imaging device, microscope device, image processing method, and image processing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322329 A1
- Document ID: US20180322329A1
- Status: Published application
- Kind: A1
- Application number: 16/037,416
- Filed: 2018-07-17
- Published: 2018-11-08
- Earliest claimed: 2011-12-28
- Assignees: Hamamatsu Photonics K.K.
- Applicants: Hamamatsu Photonics K.K.
- Inventors: Tomochika TAKESHIMA
- Web page: https://patentgrep.com/patent/US20180322329A1

## CPC

- G06V 20/698: {Matching; Classification}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The image processing device 10 includes a template preparation unit 15 for preparing, from a template included in pixels of M rows and M columns (M is an integer not less than 3) corresponding to a molecular model, a partial template corresponding to a shape for which a shape of the molecular model is divided, an evaluation value calculation unit 17 for evaluating, in the optical image, by use of the partial template, matching between the optical image and the partial template to calculate an evaluation value for every plurality of the attention pixels, and a molecular location identification unit 18 for identifying the molecular location in the optical image based on the evaluation value.

## Claims

### Claim at position 1

1-9. (canceled)

### Claim at position 2

10: An image processing device for identifying a molecular location based on an image picture of a sample, comprising:
a memory configured to store at least one image picture captured by a camera, the image picture including a plurality of pixels;
a processor communicatively coupled to the memory, the processor configured to:
prepare a template corresponding to a molecular model, the template being a two-dimensional image;
prepare a plurality of partial templates from the template, wherein each partial template corresponds to a circular sector shape having a central angle;
obtain the image picture;
select at least one pixel out of the pixels included in the image picture for which an evaluation value is to be calculated;
set a central angle of a partial template based on a luminance value of the selected pixel;
select a partial template out of the prepared plurality of partial templates according to the set central angle;
calculate an evaluation value of the selected pixel using the selected partial template; and
identify the molecular location in the image picture based on the calculated evaluation value.

### Claim at position 3 (depends on 10)

11: The image processing device according to claim 10, wherein
the template comprises pixels corresponding to a circular image, and
the central angle is set by multiplying a central angle of the circular image by α (α is a number less than 1 and more than 0).

### Claim at position 4 (depends on 11)

12: The image processing device according to claim 11, wherein
the processor is configured to select a predetermined ratio corresponding to the number a based on the luminance value of the selected pixel.

### Claim at position 5 (depends on 10)

13: The image processing device according to claim 10, wherein
the processor is configured to identify the selected pixel as the molecular location, to divide the selected pixel identified as the molecular location into a plurality of divided regions, to recalculate the evaluation value for each of the divided regions by use of the partial template, and to re-identify the molecular location in the image picture based on the evaluation value calculated for the plurality of divided regions in the selected pixel.

### Claim at position 6 (depends on 10)

14: An imaging device comprising:
the image processing device according to claim 10; and
the camera configured to capture the image picture.

### Claim at position 7 (depends on 10)

15: A microscope device comprising:
the image processing device according to claim 10;
the camera configured to capture the image picture; and
an optical system configured to generate an optical image of the sample and to provide the optical image for the camera.

### Claim at position 8

16: An image processing method for identifying a molecular location based on an image picture of a sample, comprising:
storing at least one image picture captured by a camera into memory, the image picture including a plurality of pixels;
preparing a template corresponding to a molecular model, the template being a two-dimensional image;
preparing a plurality of partial templates from the template, wherein each partial template corresponds to a circular sector shape having a central angle;
obtaining the image picture;
selecting at least one pixel out of the pixels included in the image picture for which an evaluation value is to be calculated;
setting a central angle of a partial template based on a luminance value of the selected pixel;
selecting a partial template out of the prepared plurality of partial templates according to the set central angle;
calculating an evaluation value of the selected pixel using the selected partial template; and
identifying the molecular location in the image picture based on the calculated evaluation value.

### Claim at position 9

17: A non-transitory computer-readable medium containing program instructions for causing a computer to perform a method, in an image processing device for identifying a molecular location based on an image picture of a sample, of:
storing at least one image picture captured by a camera into memory, the image picture including a plurality of pixels;
preparing a template corresponding to a molecular model, the template being a two-dimensional image;
preparing a plurality of partial templates from the template, wherein each partial template corresponds to a circular sector shape having a central angle;
obtaining the image picture;
selecting at least one pixel out of the pixels included in the image picture for which an evaluation value is to be calculated;
setting a central angle of a partial template based on a luminance value of the selected pixel;
selecting a partial template out of the prepared plurality of partial templates according to the set central angle;
calculating an evaluation value of the selected pixel using the selected partial template; and
identifying the molecular location in the image picture based on the calculated evaluation value.

### Claim at position 10 (depends on 10)

18: The image processing device according to claim 10, wherein the processor is configured to set a small central angle of the selected partial template when the luminance value of the selected pixel is high.
