# US 2020/0265275 A1 · Classification of polyps using learned image analysis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0265275 A1
- Document ID: US20200265275A1
- Status: Published application
- Kind: A1
- Application number: 16/339,921
- Filed: 2017-10-06
- Published: 2020-08-20
- Earliest claimed: 2016-10-07
- Assignees: Baylor Research Institute
- Applicants: Baylor Research Institute
- Inventors: Themistocles DASSOPOULOS; Nikolaos BOURBAKIS
- Web page: https://patentgrep.com/patent/US20200265275A1

## CPC

- A61B 5/7267: {involving training the classification device}
- A61B 5/4216: {Diagnosing or evaluating gastrointestinal ulcers}
- G06F 16/583: using metadata automatically derived from the content
- G06F 18/24317: {Piecewise classification, i.e. whereby each classification requires several discriminant rules}
- G06F 18/24323: {Tree-organised classifiers}
- G06N 5/04: Inference or reasoning models
- G06N 20/00: Machine learning
- G06Q 10/00: Administration; Management
- G06T 7/0014: {using an image reference approach}
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06V 10/141: Control of illumination
- G06V 10/143: Sensing or illuminating at different wavelengths
- G06V 10/431: {Frequency domain transformation; Autocorrelation}
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/82: using neural networks
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/30: for calculating health indices; for individual health risk assessment
- G16H 50/50: for simulation or modelling of medical disorders
- A61B 1/31: for the rectum, e.g. proctoscopes or sigmoidoscopes
- G06T 2207/30004: Biomedical image processing
- G06V 10/16: {using multiple overlapping images; Image stitching}
- G06V 2201/032: of protuberances, polyps nodules, etc.
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

Computational techniques are applied to video images of polyps to extract features and patterns from different perspectives of a polyp. The extracted features and patterns are synthesized using registration techniques to remove artifacts and noise, thereby generating improved images for the polyp. The generated images of each polyp can be used for training and testing purposes, where a machine learning system separates two types of polyps.

## Claims

### Claim 1

A system for classifying polyps, the system comprising:
an polyp image database comprising, for a plurality of polyps, images of the plurality of polyps taken from different perspectives;
a polyp imaging engine, the polyp imaging engine configured to:
compile, for at least one of the plurality of polyps, images of at least one of the plurality of polyps taken from different perspectives,
generate, from the compiled images of the at least one polyp, a new polyp image, the new polyp image having fewer reflection artifacts and occlusions than the compiled images, and
compute, based on the generated new polyp image, a polyp surface model; and
a learning engine, the learning engine configured to:
apply linear subspace learning techniques and nonlinear subspace learning techniques to identify discriminate features in the polyp surface model, and
based on the identified discriminate features, classify the polyp as adenomatous or hyperplastic.

### Claim 2 (depends on 1)

The system of claim 1 where at least one of the images of the plurality of polyps taken from different perspectives comprises images generated using Narrow Band Imaging (NBI).

### Claim 3 (depends on 2)

The system of claim 2 where generating the images of the plurality of polyps taken from different perspectives using NBI comprises:
generating a first image of at least one of the plurality of polyps using a light source emitting at or about 415 nanometers, and
generating a second image of the at least one of the plurality of polyps using a light source emitting at or about 540 nanometers.

### Claim 4 (depends on 1)

The system of claim 1 where at least one of the images of the plurality of polyps taken from different perspectives comprises images generated using a white light (WL) source

### Claim 5 (depends on 1)

The system of claim 1 where applying subspace learning techniques to identify discriminate features in the polyp surface model comprises:
developing sparse representations of the polyp to build polyp representations that are not affected by imagine artifacts and occlusions.

### Claim 6 (depends on 5)

The system of claim 5 where the developed sparse representations are utilized to:
estimate accurate decision functions and separation between statistical prototype of adenomas and non-adenomas polyps.

### Claim 7 (depends on 1)

The system of claim 1 where the polyp imaging engine further configured to:
generate color and texture data for images of at least one of the plurality of polyps taken from different perspectives.

### Claim 8

A method for classifying polyps, the method comprising:
storing, in an image database, for a plurality of polyps, images of the plurality of polyps taken from different perspectives;
compiling, for at least one of the plurality of polyps, images of at least one of the plurality of polyps taken from different perspectives,
generating, from the compiled images of the at least one polyp, a new polyp image, the new polyp image having fewer reflection artifacts and occlusions than the compiled images, and
computing, based on the generated new polyp image, a polyp surface model; and
applying, by a learning engine, a linear subspace learning techniques and nonlinear subspace learning techniques to identify discriminate features in the polyp surface model, and
based on the identified discriminate features, classifying the polyp as adenomatous or hyperplastic.

### Claim 9 (depends on 8)

The method of claim 8 further comprising:
generating at least one of the images of the plurality of polyps taken from different perspective using Narrow Band Imaging (NBI).

### Claim 10 (depends on 9)

The method of claim 9 where generating the images of the plurality of polyps taken from different perspectives using NBI comprises:
generating a first image of at least one of the plurality of polyps using a light source emitting at or about 415 nanometers, and
generating a second image of the at least one of the plurality of polyps using a light source emitting at or about 540 nanometers.

### Claim 11 (depends on 8)

The method of claim 8 where at least one of the images of the plurality of polyps taken from different perspectives comprises images generated using a white light (WL) source.

### Claim 12 (depends on 8)

The method of claim 8 further comprising:
developing sparse representations of the polyp to build polyp representations that are not affected by imagine artifacts and occlusions.

### Claim 13 (depends on 12)

The method of claim 12 further comprising:
estimating accurate decision functions and separation between statistical prototype of adenomas and non-adenomas polyps.

### Claim 14 (depends on 8)

The method of claim 8 further comprising:
generating color and texture data for images of at least one of the plurality of polyps taken from different perspectives.
