# US 2025/0017456 A1 · Endoscopic control apparatus, endoscope system, medical system, and endoscopic control method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0017456 A1
- Document ID: US20250017456A1
- Status: Published application
- Kind: A1
- Application number: 18/765,513
- Filed: 2024-07-08
- Published: 2025-01-16
- Earliest claimed: 2023-07-10
- Assignees: Olympus Medical Systems Corp.
- Applicants: Olympus Medical Systems Corp.
- Inventors: Osamu NONAKA; Masahiro ASHIZUKA
- Web page: https://patentgrep.com/patent/US20250017456A1

## CPC

- A61B 1/000094: {extracting biological structures}
- A61B 1/000096: {using artificial intelligence}
- A61B 1/000095: {for image enhancement}
- A61B 1/0005: {combining images e.g. side-by-side, superimposed or tiled}
- A61B 1/045: Control thereof
- G06T 7/0012: {Biomedical image inspection}
- G06T 2207/10068: Endoscopic image
- G06T 2207/30028: Colon; Small intestine
- G06T 2207/30032: Colon polyp
- G06T 2207/30092: Stomach; Gastric
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An endoscopic control apparatus includes one or more processors configured to process image matching with respect to a first image and a second image to determine an image in the first image and the second image, the first image obtained from an endoscope during an endoscopy, the image feature comprises information related to common pixels among the first image and the second image, detect a treatment target based on the image feature obtained from the image matching, determine a treatment instrument based on the detected treatment target, and display guide information, the guide information includes information related to the treatment instrument.

## Claims

### Claim 1

An endoscopic control apparatus, comprising:
one or more processors configured to:
process image matching with respect to a first image and a second image to determine an image in the first image and the second image, the first image obtained from an endoscope during an endoscopy, the image feature comprises information related to common pixels among the first image and the second image;
detect a treatment target based on the image feature obtained from the image matching,
determine a treatment instrument based on the detected treatment target, and
display guide information,
wherein the guide information includes information related to the treatment instrument.

### Claim 2 (depends on 1)

The endoscopic control apparatus according to claim 1, wherein the one or more processors is configured to:
process one or more color adjustment processing, matrix conversion processing, noise removal processing to the image.

### Claim 3 (depends on 1)

The endoscopic control apparatus according to claim 1, wherein the second image is obtained from the endoscope during the endoscopy, and
the image feature includes information related to pixels corresponding a common feature between the first image and the second image, the common feature is obtained from image matching.

### Claim 4 (depends on 1)

The endoscopic control apparatus according to claim 1, wherein the second image is a template image, and
the image feature includes information related to pixels corresponding a common feature between the first image and the second image, the common feature is obtained from image matching.

### Claim 5 (depends on 1)

The endoscopic control apparatus according to claim 1, wherein the image feature includes a blurring amount of a distal end of the endoscope.

### Claim 6 (depends on 1)

The endoscopic control apparatus according to claim 1, wherein the guide information includes a location of the treatment instrument.

### Claim 7 (depends on 1)

The endoscopic control apparatus according to claim 1, wherein the one or more processors is configured to:
determine whether the treatment instrument is present on a treatment instrument cart; and
in response to the determining that the treatment instrument is present on the treatment instrument cart, output the guide information including the treatment instrument presented on the treatment instrument cart.

### Claim 8 (depends on 4)

The endoscopic control apparatus according to claim 4, wherein the one or more processors is configured to:
in response to the determining that the treatment instrument is not present on the treatment instrument cart, determine whether a substitute treatment instrument is present on the treatment instrument cart, and
the guide information includes information related to the substitute treatment instrument.

### Claim 9 (depends on 1)

The endoscopic control apparatus according to claim 1, wherein the one or more processors is configured to determine the treatment instrument using an inference model, and
wherein the inference model is obtained from learning training data obtained by annotating a treatment instrument appearing in an endoscopic image obtained from the endoscope during the endoscopy.

### Claim 10 (depends on 1)

The endoscopic control apparatus according to claim 1, wherein the one or more processors is configured to:
determine the treatment instrument based on the detected treatment target and a database reference.

### Claim 11 (depends on 1)

The endoscopic control apparatus according to claim 1, wherein the one or more processors is further configured to:
calculate a treatment time period for treating a lesion part based on an endoscopic image obtained from the endoscope during the endoscopy; and
determine a degree of difficulty based on the treatment time period and the treatment instrument, and
wherein the guide information includes the degree of difficulty.

### Claim 12 (depends on 1)

The endoscopic control apparatus according to claim 1, further comprising:
a communication apparatus configured to wirelessly communicate with an electronic tag provided in the treatment instrument,
wherein the one or more processors is configured to check for a presence of the treatment instrument by communication between the communication apparatus and the electronic tag.

### Claim 13 (depends on 1)

The endoscopic control apparatus according to claim 1, wherein the image feature indicates one or more of a location of the treatment target, a shape of the treatment target, a size of the treatment target, a color of the treatment target, an edge of the treatment target, a focused area of the treatment target, concavity and convexity about the treatment target, a blood pattern about the treatment target, a blood arrangement about the treatment target or a distance between the endoscope and the treatment target.

### Claim 14 (depends on 1)

The endoscopic control apparatus according to claim 1, wherein the treatment instrument comprises one of a snare, a biopsy forceps, a grasping forceps, a basket, a high frequency a knife or a syringe needle.

### Claim 15 (depends on 1)

An endoscope system comprising:
the endoscopic control apparatus according to claim 1.

### Claim 16 (depends on 15)

The endoscope system according to claim 15, further comprising:
display equipment.

### Claim 17 (depends on 15)

A medical system, comprising:
the endoscope system according to claim 15; and
display equipment.

### Claim 18

An endoscopic control method, comprising:
processing image matching with respect to a first image and a second image to determine an image feature in the first image and the second image, the first image obtained from an endoscope during an endoscopy, the image feature comprises information related to common pixels among the first image and the second image;
detecting a treatment target of the image feature obtained from the image matching;
determining a treatment instrument based on the image feature of the treatment target; and
displaying guide information,
wherein the guide information includes information related to the treatment instrument.

### Claim 19

An endoscopic control method, comprising:
detecting a treatment target of a first image feature from first images obtained from an image pick-up device of an endoscope during a first endoscopy;
determine a second image feature based on the first image feature, the second image feature is obtained from a second images during a second endoscopy being conducted prior to the first endoscopy;
determining a treatment instrument based on the second image feature, the treatment instrument being included in third image subsequent to the second image; and
determining a treatment instrument candidate corresponding to the treatment instrument; and
displaying guide information including information related to the treatment instrument candidate.

### Claim 20 (depends on 19)

The endoscopic control method according to claim 19, wherein the determining that the treatment instrument comprises:
referencing a database storing the second image feature associated with the treatment instrument.
