# US 2023/0410303 A1 · Medical image processing apparatus, endoscope system, medical image processing method, and medical image processing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410303 A1
- Document ID: US20230410303A1
- Status: Published application
- Kind: A1
- Application number: 18/458,121
- Filed: 2023-08-29
- Published: 2023-12-21
- Earliest claimed: 2021-03-01
- Assignees: FUJIFILM Corporation
- Applicants: FUJIFILM Corporation
- Inventors: Shumpei KAMON
- Web page: https://patentgrep.com/patent/US20230410303A1

## CPC

- A61B 1/000094: {extracting biological structures}
- G06T 7/0012: {Biomedical image inspection}
- A61B 1/000095: {for image enhancement}
- A61B 1/0005: {combining images e.g. side-by-side, superimposed or tiled}
- A61B 1/00055: {for alerting the user}
- A61B 1/0638: {providing two or more wavelengths}
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G09G 5/377: for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence)
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10068: Endoscopic image
- G06T 2207/30028: Colon; Small intestine
- G06T 2207/30096: Tumor; Lesion
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- G09G 2340/12: Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
- G09G 2380/08: Biomedical applications
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A medical image processing apparatus according to one aspect of the present invention is a medical image processing apparatus including a processor. The processor is configured to execute an image acquisition process of acquiring a time-series medical image; a region-of-interest detection process of detecting a region of interest from the acquired medical image; a display control process of causing a display apparatus to display the medical image; a first reporting process of, in response to the region of interest being detected in the region-of-interest detection process, causing the display apparatus to perform superimposed display of the medical image and information about the detected region of interest; and a second reporting process of, in response to the region of interest being detected in the region-of-interest detection process, outputting a sound from a sound output apparatus. The processor is configured to execute the second reporting process after the first reporting process.

## Claims

### Claim 1

A medical image processing apparatus comprising a processor,
the processor being configured to execute:
an image acquisition process of acquiring a time-series medical image;
a region-of-interest detection process of detecting a region of interest from the acquired medical image;
a display control process of causing a display apparatus to display the medical image;
a first reporting process of, in response to the region of interest being detected in the region-of-interest detection process, causing the display apparatus to perform superimposed display of the medical image and information about the detected region of interest; and
a second reporting process of, in response to the region of interest being detected in the region-of-interest detection process, outputting a sound from a sound output apparatus, wherein
the processor is configured to execute the second reporting process after the first reporting process.

### Claim 2 (depends on 1)

The medical image processing apparatus according to claim 1, wherein the processor is configured to execute the second reporting process in response to the region of interest being detected after a first period elapses from when the region of interest is detected in the region-of-interest detection process, and is configured not to execute the second reporting process in response to the region of interest not being detected after the first period elapses.

### Claim 3 (depends on 1)

The medical image processing apparatus according to claim 1, wherein the processor is configured to, in the first reporting process, cause the display apparatus to perform the superimposed display of the information in accordance with a position of the region of interest in the medical image.

### Claim 4 (depends on 1)

The medical image processing apparatus according to claim 1, wherein the processor is configured to
execute a number-of-detections calculation process of calculating the number of consecutive detections for the region of interest detected in the region-of-interest detection process, and
execute the second reporting process in response to the number of consecutive detections exceeding a predetermined number.

### Claim 5 (depends on 4)

The medical image processing apparatus according to claim 4, wherein the processor is configured to further execute:
a feature quantity hold process of holding a feature quantity of the detected region of interest; and
an identity determination process of comparing a feature quantity of a first region of interest detected from a medical image captured at a first time with the held feature quantity of a second region of interest detected from a second medical image captured at a second time that is a time before the first time, thereby determining identity between the first region of interest and the second region of interest, wherein
the processor is configured to, in the number-of-detections calculation process, calculate the number of consecutive detections for the first region of interest in accordance with a determination result obtained in the identity determination process.

### Claim 6 (depends on 5)

The medical image processing apparatus according to claim 5, wherein the processor is configured to, in response to a determination being made in the identity determination process that the first region of interest and the second region of interest are identical to each other, in the number-of-detections calculation process, increase the number of consecutive detections recorded for the second region of interest to calculate the number of consecutive detections of the first region of interest.

### Claim 7 (depends on 5)

The medical image processing apparatus according to claim 5, wherein the processor is configured to, in the identity determination process, determine the identity by comparing, of the feature quantity held in the feature quantity hold process, a feature quantity obtained at a time that is within a determined period before the first time, with the feature quantity of the first region of interest.

### Claim 8 (depends on 1)

The medical image processing apparatus according to claim 1, wherein the processor is configured to, in the second reporting process, cause the sound output apparatus not to output a sound for a determined period after causing the sound output apparatus to output a sound.

### Claim 9 (depends on 1)

The medical image processing apparatus according to claim 1, wherein the processor is configured to, in the first reporting process, change a mode of the first reporting process in accordance with a sound output state in the second reporting process.

### Claim 10 (depends on 1)

The medical image processing apparatus according to claim 1, wherein the processor is configured to, in the first reporting process, cause the display apparatus to perform the superimposed display of the information, the information being at least one of a character, a figure, or a symbol.

### Claim 11 (depends on 1)

An endoscope system comprising:
the medical image processing apparatus according to claim 1;
an endoscope to be inserted into a subject, the endoscope having an imaging unit configured to capture the medical image;
the display apparatus; and
the sound output apparatus.

### Claim 12

A medical image processing method to be executed by a medical image processing apparatus comprising a processor,
the processor being configured to execute:
an image acquisition step of acquiring a time-series medical image;
a region-of-interest detection step of detecting a region of interest from the acquired medical image;
a display control step of causing a display apparatus to display the medical image;
a first reporting step of, in response to the region of interest being detected in the region-of-interest detection step, causing the display apparatus to perform superimposed display of the medical image and information about the detected region of interest; and
a second reporting step of, in response to the region of interest being detected in the region-of-interest detection step, outputting a sound from a sound output apparatus, wherein
the processor is configured to execute the second reporting step after the first reporting step.

### Claim 13 (depends on 12)

A non-transitory computer-readable recording medium storing a program for causing, when read by a computer, the computer to execute the medical image processing method according to claim 12.
