# US 2024/0172919 A1 · Endoscopic examination support apparatus, endoscopic examination support method, and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0172919 A1
- Document ID: US20240172919A1
- Status: Published application
- Kind: A1
- Application number: 18/545,102
- Filed: 2023-12-19
- Published: 2024-05-30
- Earliest claimed: 0001-01-01
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Atsushi MARUGAME
- Web page: https://patentgrep.com/patent/US20240172919A1

## CPC

- G06T 7/0012: {Biomedical image inspection}
- G16H 30/40: for processing medical images, e.g. editing
- A61B 1/00: Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes (examination of body cavities or body tracts using ultrasonic, sonic or infrasonic waves A61B8/12; endoscopic instruments for taking cell samples or for biopsy A61B10/04); Illuminating arrangements therefor (for the eyes A61B3/00)
- A61B 1/00006: {of control signals}
- A61B 1/000094: {extracting biological structures}
- A61B 1/000096: {using artificial intelligence}
- A61B 1/00045: {Display arrangement}
- A61B 1/045: Control thereof
- A61B 5/0084: {for introduction into the body, e.g. by catheters (A61B5/1459 takes precedence)}
- A61B 5/4255: {Intestines, colon or appendix}
- A61B 5/7275: {Determining trends in physiological measurement data; Predicting development of a medical condition based on physiological measurements, e.g. determining a risk factor}
- G06T 7/60: Analysis of geometric attributes
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/75: {involving models}
- G16H 40/63: for local operation
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/30: for calculating health indices; for individual health risk assessment
- A61B 2576/00: Medical imaging apparatus involving image processing or analysis (A61B1/00009, A61B6/52 and A61B8/52 take precedence)
- G06T 2207/10024: Color image
- G06T 2207/10068: Endoscopic image
- G06T 2207/20081: Training; Learning
- G06T 2207/30028: Colon; Small intestine
- G06T 2207/30096: Tumor; Lesion
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

In the endoscopic examination support apparatus, the lesion candidate detection means detects a lesion candidate from an endoscopic image acquired by imaging an interior of a luminal organ. The flag setting means sets a flag according to a position in the interior of the luminal organ at which the endoscopic image including the lesion candidate is acquired. The risk determination means determines a risk of the lesion candidate based on at least a size of the lesion candidate and the flag. The display image generation means generates a display image including information relating to a position of the lesion candidate in the endoscopic image, information relating to a position in the interior of the luminal organ corresponding to the flag, and information relating to the risk of the lesion candidate.

## Claims

### Claim 1

An endoscopic examination support apparatus comprising:
a memory configured to store instructions; and
a processor configured to execute the instructions to:
detect a lesion candidate from an endoscopic image acquired by imaging an interior of a luminal organ;
set, as a flag according to a position in the interior of the luminal organ at which the endoscopic image including the lesion candidate is acquired, a first flag and a second flag, the first flag being set in a period from a time when pull-out of the endoscope camera inserted into the interior of the luminal organ in order to acquire the endoscopic image is started to a time when the endoscope camera passes through a predetermined site in the luminal organ, the second flag being set in a period from a time when the endoscope camera passes through the predetermined site to a time when pull-out of the endoscope camera is completed;
determine a risk of the lesion candidate based on at least a size of the lesion candidate and the flag;
generate a display image including information relating to a position of the lesion candidate in the endoscopic image, information relating to a position in the interior of the luminal organ corresponding to the flag, information relating to the risk of the lesion candidate, a detection frame surrounding the lesion candidate present in the endoscopic image, and a tag added to the detection frame to display different information according to the flag and the risk of the lesion candidate; and
output the display image.

### Claim 2 (depends on 1)

The endoscopic examination support apparatus according to claim 1,
wherein the processor is further configured to execute the instructions to determine that the risk of a first lesion candidate is equal to or larger than the risk of a second lesion candidate when the size of the first lesion candidate included in the endoscopic image corresponding to the first flag and the size of the second lesion candidate included in the endoscopic image corresponding to the second flag are equal.

### Claim 3 (depends on 1)

The endoscopic examination support apparatus according to claim 1, wherein the processor is further configured to execute the instructions to determine that the risk of the first lesion candidate is equal to or larger than the risk of the second lesion candidate when the size of the first lesion candidate and the size of the second lesion candidate are equal and the type of the first lesion candidate and the type of the second lesion candidate are same.

### Claim 4 (depends on 1)

The endoscopic examination support device according to claim 1, wherein is further configured to execute the instructions to, in a case where the luminal organ is colon, set the first flag in a period from a time when the endoscope camera reaches a cecum to a time when the endoscope camera passes a splenic curvature, and the second flag in a period from a time when the endoscope camera passes through the splenic curvature to a time when the endoscope camera passes through an anus.

### Claim 5 (depends on 1)

The endoscopic examination support apparatus according to claim 1, wherein the processor is further configured to execute the instructions to generate, as the display image, an image including a detection frame which surrounds the lesion candidate present in the endoscopic image and is displayed in different manners according to the flag and the risk of the lesion candidate.

### Claim 6 (depends on 5)

The endoscopic examination support apparatus according to claim 5, wherein the processor is further configured to execute the instructions to generate as the detection frame, a frame having different line types according to the flag.

### Claim 7 (depends on 5)

The endoscopic examination support apparatus according to claim 5, wherein the processor is further configured to execute the instructions to generate, as the detection frame, a frame having different colors according to the risk of the lesion candidate.

### Claim 8 (depends on 1)

The endoscopic examination support apparatus according to claim 1, wherein the processor is further configured to set the flag using a machine learning model trained to output data used to identify the position in the colon corresponding to the image including a subject in the colon in response to the input of the image.

### Claim 9 (depends on 1)

The endoscopic examination support apparatus according to claim 1, wherein the display image is displayed as a guide to the risk of the lesion candidate to support decision making of a doctor.

### Claim 10

An endoscopic examination support method comprising:
detecting a lesion candidate from an endoscopic image acquired by imaging an interior of a luminal organ;
setting, as a flag according to a position in the interior of the luminal organ at which the endoscopic image including the lesion candidate is acquired, a first flag and a second flag, the first flag being set in a period from a time when pull-out of the endoscope camera inserted into the interior of the luminal organ in order to acquire the endoscopic image is started to a time when the endoscope camera passes through a predetermined site in the luminal organ, the second flag being set in a period from a time when the endoscope camera passes through the predetermined site to a time when pull-out of the endoscope camera is completed;
determining a risk of the lesion candidate based on at least a size of the lesion candidate and the flag;
generating a display image including information relating to a position of the lesion candidate in the endoscopic image, information relating to a position in the interior of the luminal organ corresponding to the flag, information relating to the risk of the lesion candidate, a detection frame surrounding the lesion candidate present in the endoscopic image, and a tag added to the detection frame to display different information according to the flag and the risk of the lesion candidate; and
outputting the display image.

### Claim 11

A non-transitory computer-readable recording medium storing a program, the program causing a computer to execute:
detecting a lesion candidate from an endoscopic image acquired by imaging an interior of a luminal organ;
setting, as a flag according to a position in the interior of the luminal organ at which the endoscopic image including the lesion candidate is acquired, a first flag and a second flag, the first flag being set in a period from a time when pull-out of the endoscope camera inserted into the interior of the luminal organ in order to acquire the endoscopic image is started to a time when the endoscope camera passes through a predetermined site in the luminal organ, the second flag being set in a period from a time when the endoscope camera passes through the predetermined site to a time when pull-out of the endoscope camera is completed;
determining a risk of the lesion candidate based on at least a size of the lesion candidate and the flag;
generating a display image including information relating to a position of the lesion candidate in the endoscopic image, information relating to a position in the interior of the luminal organ corresponding to the flag, information relating to the risk of the lesion candidate, a detection frame surrounding the lesion candidate present in the endoscopic image, and a tag added to the detection frame to display different information according to the flag and the risk of the lesion candidate; and
outputting the display image.
