# US 2021/0343399 A1 · Medical image processing apparatus, medical observation apparatus, and image processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0343399 A1
- Document ID: US20210343399A1
- Status: Published application
- Kind: A1
- Application number: 17/376,183
- Filed: 2021-07-15
- Published: 2021-11-04
- Earliest claimed: 2018-03-12
- Assignees: Sony Olympus Medical Solutions Inc.
- Applicants: Sony Olympus Medical Solutions Inc.
- Inventors: Masataka KADO
- Web page: https://patentgrep.com/patent/US20210343399A1

## CPC

- G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
- G16H 30/40: for processing medical images, e.g. editing
- A61B 3/10: Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B 3/13: Ophthalmic microscopes
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/73: Deblurring; Sharpening
- G06T 7/0012: {Biomedical image inspection}
- A61B 3/0008: {provided with illuminating means (A61B3/117, A61B3/14 take precedence)}
- A61B 3/18: Arrangement of plural eye-testing or -examining apparatus
- G06T 2207/10012: Stereo images
- G06T 2207/10068: Endoscopic image
- G06T 2207/30096: Tumor; Lesion
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

There is provided a medical image processing apparatus including: an association processing section configured to associate multiple medical captured images in which an observation target is imaged by each of multiple imaging devices including imaging devices in which one or both of an in-focus position and an in-focus range are different; and a compositing processing section configured to depth-composite each of a medical captured image for a right eye and a medical captured image for a left eye among the multiple medical captured images by using an associated other medical captured image.

## Claims

### Claim 1

(canceled)

### Claim 2

A medical image processing apparatus comprising:
circuitry configured to:
associate multiple medical images in which an observation target is imaged by each of multiple imaging devices including a first imaging device and a second imaging device located at a same position relative to the observation target; and
depth-composite each of a medical image for a right eye and a medical image for a left eye among the multiple medical images by using information obtained by a third imaging device, wherein one or both of an in-focus position and an in-focus range of the third imaging device is different from an in-focus position and an in-focus range of the at least one of the first imaging device and the second imaging device.

### Claim 3 (depends on 2)

The medical image processing apparatus according to claim 2, wherein the first imaging device and the second imaging device have the same in-focus position and in-focus range.

### Claim 4 (depends on 2)

The medical image processing apparatus according to claim 2, wherein one or both of an in-focus position and an in-focus range are different for the first imaging device and the second imaging device.

### Claim 5 (depends on 2)

The medical image processing apparatus according to claim 2, wherein
the third imaging device is included in the multiple imaging devices, and
the information obtained by the third imaging device is an associated other medical image.

### Claim 6 (depends on 5)

The medical image processing apparatus according to claim 5, wherein the in-focus range of the third imaging device is larger than the in-focus range of one of the first imaging device and the second imaging device.

### Claim 7 (depends on 5)

The medical image processing apparatus according to claim 5, wherein the in-focus position is different for the first imaging device, the second imaging device and the third imaging device.

### Claim 8 (depends on 2)

The medical image processing apparatus according to claim 2, wherein the circuitry is configured to depth-composite by complementing each of the medical images for the right eye and the medical image for the left eye with the other medical image of a higher resolution.

### Claim 9 (depends on 2)

The medical image processing apparatus according to claim 2, wherein the circuitry is configured to associate the multiple medical images by extracting a characteristic portion from each of the multiple medical images and matching the extracted characteristic portions.

### Claim 10 (depends on 2)

The medical image processing apparatus according to claim 2, wherein the circuitry is configured to associate the multiple medical images by estimating a same subject included in each of the multiple medical images on a basis of settings information indicating settings of each of the multiple imaging devices.

### Claim 11 (depends on 2)

The medical image processing apparatus according to claim 2, wherein the multiple imaging devices are a first imaging device capturing the medical image for the right eye and a second imaging device capturing the medical image for the left eye, the circuitry is configured to:
associate the medical image for the right eye and the medical image for the left eye, and
depth-composite each of the medical image for the right eye and the medical image for the left eye by using the associated other medical image.

### Claim 12 (depends on 2)

The medical image processing apparatus according to claim 2, wherein the multiple imaging devices are the first imaging device capturing the medical image for the right eye, a second imaging device capturing the medical image for the left eye, and the one or multiple third imaging devices capturing a medical image to use in depth compositing.

### Claim 13 (depends on 12)

The medical image processing apparatus according to claim 12, wherein
the first imaging device and the second imaging device have the same in-focus position and in-focus range, and
the other medical image used in depth compositing is a medical image captured by the one or multiple third imaging devices.

### Claim 14 (depends on 12)

The medical image processing apparatus according to claim 12, wherein in each of the first imaging device, the second imaging device, and the third imaging device, one or both of the in-focus position and the in-focus range are different.

### Claim 15 (depends on 2)

The medical image processing apparatus according to claim 2, wherein the circuitry is further configured to:
cause each of the depth-composited medical image for the right eye and the depth-composited medical image for the left eye to be displayed on a display screen.

### Claim 16 (depends on 2)

The medical image processing apparatus according to claim 2, wherein a first medical image of the multiple medical images has a first resolution and a first field of view, a second medical image of the multiple medical images has a second resolution and a second field of view, the first resolution being greater than the second resolution and the second field of view being wider than the first field of view, and a depth-composite image of the first and second medical images has the first resolution and the second field of view.

### Claim 17 (depends on 2)

The medical image processing apparatus according to claim 2, wherein each of the multiple imaging devices have an optical path through a common lens.

### Claim 18

A medical observation apparatus comprising:
multiple imaging devices including a first imaging device and a second imaging device located at a same position relative to an observation target, each configured to image an observation target; and
circuitry configured to
associate multiple medical images captured by each of the first imaging device and the second imaging device; and
depth-composite each of a medical image for a right eye and a medical image for a left eye among the multiple medical images by using information obtained by a sensor, wherein one or both of an in-focus position and an in-focus range of the sensor is different from one or both of an in-focus position and an in-focus range of the at least one of the first imaging device and the second imaging device.

### Claim 19 (depends on 18)

The medical observation apparatus according to claim 18, further comprising:
an arm including multiple links joined to each other by one or multiple joint sections, wherein the multiple imaging devices are supported by the arm.

### Claim 20 (depends on 18)

The medical observation apparatus according to claim 18, wherein the multiple imaging devices are inserted into an inside of a body of a patient and images the inside of the body as the observation target.

### Claim 21

An image processing method, executed by a medical image processing apparatus, comprising:
associating multiple medical images in which an observation target is imaged by each of multiple imaging devices including a first imaging device and a second imaging device located at a same position relative to the observation target; and
depth-compositing each of a medical image for a right eye and a medical image for a left eye among the multiple medical images by using information obtained by a sensor, wherein one or both of an in-focus position and an in-focus range of the sensor is different from one or both of an in-focus position and an in-focus range of the at least one of the first imaging device and the second imaging device.

### Claim 22 (depends on 21)

The image processing method according to claim 21, wherein a first medical image of the multiple medical images has a first resolution and a first field of view, a second medical image of the multiple medical images has a second resolution and a second field of view, the first resolution being greater than the second resolution and the second field of view being wider than the first field of view, and a depth-composite image of the first and second medical images has the first resolution and the second field of view.

### Claim 23 (depends on 21)

The image processing method according to claim 21, wherein each of the multiple imaging devices have an optical path through a common lens.
