# US 2023/0274422 A1 · Systems and methods for identifying images of polyps

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274422 A1
- Document ID: US20230274422A1
- Status: Published application
- Kind: A1
- Application number: 18/020,291
- Filed: 2021-09-03
- Published: 2023-08-31
- Earliest claimed: 2020-09-08
- Assignees: Given Imaging Ltd.
- Applicants: Given Imaging LTD.
- Inventors: Dori Peleg
- Web page: https://patentgrep.com/patent/US20230274422A1

## CPC

- G06T 7/0012: {Biomedical image inspection}
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- A61B 1/041: {Capsule endoscopes for imaging}
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10068: Endoscopic image
- G06T 2207/20081: Training; Learning
- G06T 2207/30032: Colon polyp
- G06T 2207/30092: Stomach; Gastric
- G06T 2207/30096: Tumor; Lesion
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

Systems and methods are disclosed for identifying images that contain polyps. An exemplary method for identifying images includes: accessing images of a gastrointestinal tract (GIT) captured by a capsule endoscopy device, where: each image of the images is suspected to include a polyp and is associated with a probability of containing the polyp, and the images include seed images, where each seed image is associated with one or more images of the images. The image(s) associated with each seed image is identified as suspected to include the same polyp as the associated seed image. The method includes applying a polyp detection system on the seed images to identify seed images which include polyps, where the polyp detection system is applied to each seed image of based on the image(s) associated with the seed image and the probabilities associated with the seed image and with the associated image(s).

## Claims

### Claim 1

A method for identifying images including polyps, comprising:
accessing a plurality of images of a gastrointestinal tract (GIT) captured by a capsule endoscopy device during a CE procedure, wherein:
each image of the plurality of images is suspected to include a polyp and is associated with a probability of containing the polyp, and
the plurality of images includes seed images, each seed image is associated with one or more images of the plurality of images, the one or more images associated with each seed image are identified as suspected to include the same polyp as the associated seed image; and
applying a polyp detection system on the seed images to identify seed images which include polyps, wherein the polyp detection system is applied to each seed image of the seed images based on the one or more images associated with the seed image and the probabilities associated with the seed image and with the one or more associated images.

### Claim 2 (depends on 1)

The method of claim 1, further comprising identifying images of the plurality of images which include polyps of a size equal to or higher than a predefined size, wherein each image of the plurality of images is further associated with an estimated size of the suspected polyp contained in the each image, and wherein the polyp detection system is further applied to each seed image of the seed images based on the estimated polyp sizes associated with the seed image and with the one or more images associated with the seed image.

### Claim 3 (depends on 2)

The method of claim 2, wherein the procedure is determined inadequate and excluded, and wherein at least one seed image is identified to include a polyp of a size equal or higher that the predefined size or to include a predefined number of polyps of a size equal to or higher than the predefined size, the method further comprising overruling the exclusion of the procedure.

### Claim 4 (depends on 1)

The method of claim 1, wherein the polyp detection system comprises at least one of: one or more positive filters, one or more negative filters, one or more classical machine learning systems, or a combination thereof.

### Claim 5 (depends on 4)

The method of claim 4, wherein inputs to the one or more classical machine learning systems, the one or more positive filters or the one or more negative filters comprise at least one of: a seed image probability of containing a polyp, number of images associated with a seed image, number of images associated with a seed image having a probability of containing a polyp according to a predefined threshold, or a combination thereof.

### Claim at position 6

6-8. (canceled)

### Claim 9 (depends on 1)

The method of claim 1, further comprising providing an indication to a referring physician of the CE procedure to refer a subject of the CE procedure to a colonoscopy procedure based on the seed images identified to include polyps.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
for each image of the plurality of images:
applying a classical machine learning system configured to provide the probability of the image containing the polyp, based on input features corresponding to the image, and
accessing a soft margin of the classical machine learning system corresponding to the image; and
determining, without human intervention, whether to recommend a colonoscopy based on the soft margins of the plurality of images.

### Claim 11 (depends on 10)

The method of claim 10, further comprising accessing a mapping of soft margins to probabilities of an image containing a polyp,
wherein the determining of whether to recommend a colonoscopy is further based on the mapping of soft margins to probabilities of an image containing a polyp.

### Claim 12 (depends on 10)

The method of claim 10, further comprising:
for each image of the plurality of images, accessing an estimated polyp size for the image, the estimated polyp size generated based on the image; and
accessing a mapping of estimated polyp sizes to probabilities of an actual polyp size being at least a predefined size,
wherein the determining of whether to recommend a colonoscopy is further based on the estimated polyp sizes and the mapping of estimated polyp sizes to probabilities of an actual polyp size being at least a predefined size.

### Claim 13

(canceled)

### Claim 14 (depends on 1)

The method of claim 1, further comprising providing a therapeutic recommendation based on the seed images identified to include polyps.

### Claim 15 (depends on 1)

The method of claim 1 further comprising displaying the seed images and indicating the seed images identified to include polyps.

### Claim 16 (depends on 1)

The method of claim 1, further comprising:
displaying at least the seed images to a user;
receiving user selections of images among the displayed images;
determining at least one unselected image, which was not selected by the user and which is among the seed images identified to include polyps; and
presenting the at least one unselected image to the user.

### Claim 17 (depends on 16)

The method of claim 16, wherein the images selected by the user are images selected to be included in the CE procedure report.

### Claim 18 (depends on 17)

The method of claim 17, wherein the presenting of the at least one unselected image to the user is performed once a request to generate a report is received.

### Claim at position 17

19-53. (canceled).

### Claim 54

A computer-implemented method for recommending a colonoscopy, comprising:
accessing a plurality of images of a gastrointestinal tract (GIT) captured by a capsule endoscopy device, the plurality of images having a likelihood of containing a polyp;
for each image of the plurality of images:
applying a classical machine learning system configured to provide an indication, based on input features corresponding to the image, of whether the image contains a polyp or does not contains a polyp, and
accessing a soft margin of the classical machine learning system corresponding to the image; and
determining, without human intervention, whether to recommend a colonoscopy based on the soft margins of the plurality of images.

### Claim 55 (depends on 54)

The computer-implemented method of claim 54, further comprising accessing a mapping of soft margins to probabilities of an image containing a polyp,
wherein the determining of whether to recommend a colonoscopy is further based on the mapping of soft margins to probabilities of an image containing a polyp.

### Claim 56 (depends on 54)

The computer-implemented method of claim 54, further comprising:
for each image of the plurality of images, accessing an estimated polyp size for the image, the estimated polyp size generated based on the image; and
accessing a mapping of estimated polyp sizes to probabilities of an actual polyp size being at least a predefined size,
wherein the determining of whether to recommend a colonoscopy is further based on the estimated polyp sizes and the mapping of estimated polyp sizes to probabilities of an actual polyp size being at least a predefined size.

### Claim 57

A system for recommending a colonoscopy, comprising:
one or more processors; and
at least one memory storing instructions which, when executed by the one or more processors, cause the system to:
access a plurality of images of a gastrointestinal tract (GIT) captured by a capsule endoscopy device, the plurality of images having a likelihood of containing a polyp;
for each image of the plurality of images:
apply a classical machine learning system configured to provide an indication, based on input features corresponding to the image, of whether the image contains a polyp or does not contains a polyp, and
access a soft margin of the classical machine learning system corresponding to the image; and
determine, without human intervention, whether to recommend a colonoscopy based on the soft margins of the plurality of images.

### Claim 58 (depends on 57)

The system of claim 57, wherein the instructions, when executed by the one or more processors, further cause the system to access a mapping of soft margins to probabilities of an image containing a polyp,
wherein the determining of whether to recommend a colonoscopy is further based on the mapping of soft margins to probabilities of an image containing a polyp.

### Claim 59 (depends on 57)

The system of claim 57, wherein the instructions, when executed by the one or more processors, further cause the system to:
for each image of the plurality of images, access an estimated polyp size for the image, the estimated polyp size generated based on the image; and
access a mapping of estimated polyp sizes to probabilities of an actual polyp size being at least a predefined size,
wherein the determining of whether to recommend a colonoscopy is further based on the estimated polyp sizes and the mapping of estimated polyp sizes to probabilities of an actual polyp size being at least a predefined in size.
