# US 2023/0274528 A1 · System and method for assisting with the diagnosis of otolaryngologic diseases from the analysis of images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274528 A1
- Document ID: US20230274528A1
- Status: Published application
- Kind: A1
- Application number: 18/016,322
- Filed: 2020-07-15
- Published: 2023-08-31
- Earliest claimed: 2020-07-15
- Assignees: Universidad TéCnica Federico Santa MaríA
- Applicants: Universidad TéCnica Federico Santa Maria
- Inventors: Michelle VISCAINO; Fernando AUAT CHEEIN
- Web page: https://patentgrep.com/patent/US20230274528A1

## CPC

- G06V 10/764: using classification, e.g. of video objects
- G06T 7/0012: {Biomedical image inspection}
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/82: using neural networks
- G16H 30/40: for processing medical images, e.g. editing
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10068: Endoscopic image
- G06T 2207/20061: Hough transform
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30004: Biomedical image processing
- G06T 2207/30168: Image quality inspection
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

The present invention provides a system and a method for assisting in the diagnosis of diseases from otolaryngology images that comprises: an apparatus for the acquisition of images of otolaryngologic endoscopy; a processor, operatively connected to said apparatus for the acquisition of otolaryngologic endoscopy images; and a user interface comprising a screen, said user interface operatively connected to said processor; wherein said processor is configured to: recognize a type of otolaryngologic endoscopic examination apparatus to which said apparatus belongs; obtain a plurality of images of otolaryngologic endoscopy from said apparatus; display said plurality of images on said screen; and identify, from said plurality of images, whether the same corresponds to any disease or to a healthy patient.

## Claims

### Claim 1

A system for assisting with the diagnosis of diseases from otolaryngology images of an area under examination, CHARACTERIZED in that comprises:
an apparatus for the acquisition of otolaryngologic endoscopy images;
a processor, operatively connected to said apparatus for the acquisition of otolaryngologic endoscopy images; and
a user interface that comprises a screen, said user interface operatively connected to said processor;
wherein said processor is configured to:
recognize a type of otolaryngologic endoscopic examination apparatus to which said apparatus belongs;
obtain a plurality of images of otolaryngologic endoscopy from said apparatus;
display said plurality of images on said screen; and
identify from said plurality of images, whether the same corresponds to any disease or to a healthy patient;
wherein to identify from said plurality of images, whether the same corresponds to any disease or to a healthy patient, said processor executes the tasks of:
determining, for each image of said plurality, if said image is focused or out of focus;
detecting in each image of said plurality considered focused, one or more inner structures of said area under examination, by means of a convolutional neural network trained with a plurality of images corresponding to the type of otolaryngologic endoscopic examination apparatus to which said apparatus belongs;
classifying said plurality of images using a machine learning algorithm previously trained with a plurality of data corresponding to the type of otolaryngologic endoscopic examination apparatus to which said apparatus belongs, said data that have been labeled by one or more otolaryngology professionals; and
displaying on said screen of said user interface a plurality of images highlighting said one or more inner structures and one or more results of said classification;
wherein said one or more results of said classification are obtained from those classifications that may be associated with all the structures detected in those images considered focused.

### Claim 2 (depends on 1)

The system of claim 1, CHARACTERIZED in that to detect if each image of said plurality is focused or out of focus, said processor executes the Laplacian variance method.

### Claim 3 (depends on 1)

The system of claim 1, CHARACTERIZED in that said processor, additionally, is configured to detect a region of interest in each one of said images considered focused and in that said detection of said region of interest is executed prior to said detection of one or more inner structures.

### Claim 4 (depends on 3)

The system of claim 3, CHARACTERIZED in that for said detection of said region of interest, said processor is configured to obtain a Hough transform of each of said images considered focused.

### Claim 5 (depends on 1, 5)

The system of claim 1, CHARACTERIZED in that for the detection of said one or more inner structures, said processor is configured to obtain one or more characteristics from each of said images considered focused. The system of claim 5, CHARACTERIZED in that said one or more characteristics are selected from the group formed by the color, shape, texture, edges as well as the combinations thereof.

### Claim 7 (depends on 1)

The system of claim 1, CHARACTERIZED in that for said detection of said one or more inner structures, said processor is configured to use a convolutional neural network that is selected from the group formed by Mask-CNN and U-Net.

### Claim 8 (depends on 1)

The system of claim 1, CHARACTERIZED in that to perform said classification, said processor is configured to execute an algorithm that is selected from the group formed by support vectors, decision trees, nearest neighbors, and deep learning algorithms.

### Claim 9

An ex vivo method for the assistance in the diagnosis of diseases from otolaryngology images of an area under examination, CHARACTERIZED in that comprises the steps of:
providing a system that comprises: an apparatus for the acquisition of images of otolaryngologic endoscopy; a processor, operatively connected to said apparatus for the acquisition of images of otolaryngologic endoscopy; and a user interface comprising a screen, said user interface operatively connected to said processor;
recognizing, by means of said processor, a type of otolaryngologic endoscopic examination apparatus to which said apparatus belongs;
obtaining, by means of said processor, a plurality of images of otolaryngologic endoscopy from said apparatus;
displaying said plurality of images on said screen; and
identifying from said plurality of images, whether the same corresponds to any disease or to a healthy patient, by means of said processor;
wherein to identify from said plurality of images, whether the same corresponds to any disease or to a healthy patient, said processor executes the tasks of:
determining, for each image of said plurality, if said image is focused or out of focus;
detecting in each image of said plurality considered focused, one or more inner structures of said area under examination, by means of a convolutional neural network trained with a plurality of images corresponding to the type of otolaryngologic endoscopic examination apparatus to which said apparatus belongs;
classifying said plurality of images using a machine learning algorithm previously trained with a plurality of data corresponding to the type of otolaryngologic endoscopic examination apparatus to which said apparatus belongs, said data that have been labeled by one or more otolaryngology professionals; and
displaying on said screen of said user interface a plurality of images highlighting said one or more inner structures and one or more results of said classification;
wherein said one or more results of said classification are obtained from those classifications that may be associated with all the structures detected in those images considered focused.

### Claim 10 (depends on 9)

The method of claim 9, CHARACTERIZED in that said task of detecting if each image of said plurality is focused or out of focus is performed by means of the Laplacian variance method.

### Claim 11 (depends on 9)

The method of claim 9, CHARACTERIZED in that it additionally comprises detecting a region of interest in each one of said images considered focused by means of said processor; and in that said detection of said region of interest is executed prior to said detection of one or more inner structures.

### Claim 12 (depends on 11)

The method of claim 11, CHARACTERIZED in that for said step of detecting said region of interest, it comprises obtaining by means of said processor, a Hough transform of each of said images considered focused.

### Claim 13 (depends on 9)

The method of claim 9, CHARACTERIZED in that said step of detecting said one or more inner structures comprises obtaining, by means of said processor, one or more characteristics from each of said images considered focused.

### Claim 14 (depends on 13)

The method of claim 13, CHARACTERIZED in that said one or more characteristics are selected from the group formed by the color, shape, texture, edges as well as the combinations thereof.

### Claim 15 (depends on 9)

The method of claim 9, CHARACTERIZED in that said step of detecting said one or more inner structures, comprises using, by means of said processor, a convolutional neural network that is selected from the group formed by Mask-CNN and U-Net.

### Claim 16 (depends on 9)

The method of claim 9, CHARACTERIZED in that said step of classifying said plurality of images comprises executing, by means of said processor, an algorithm that is selected from the group formed by support vectors, decision trees, nearest neighbors and deep learning algorithms.
