# US 2024/0177305 A1 · Diagnosis of a disease condition using an automated diagnostic model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0177305 A1
- Document ID: US20240177305A1
- Status: Published application
- Kind: A1
- Application number: 18/435,214
- Filed: 2024-02-07
- Published: 2024-05-30
- Earliest claimed: 2010-12-07
- Assignees: University of Iowa Research Foundation; The United States Government as represented by the Department of Veterans Affairs
- Applicants: University of Iowa Research Foundation; United States Government as Represented by the Department of Veterans Affairs
- Inventors: MICHAEL ABRAMOFF; GWENOLE QUELLEC
- Web page: https://patentgrep.com/patent/US20240177305A1

## CPC

- G06T 7/0012: {Biomedical image inspection}
- G06F 18/00: Pattern recognition
- G06T 7/75: {involving models}
- G06V 40/193: {Preprocessing; Feature extraction}
- G06T 2207/10024: Color image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30041: Eye; Retina; Ophthalmic
- G06T 2207/30096: Tumor; Lesion
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method of identifying an object of interest can comprise obtaining first samples of an intensity distribution of one or more object of interest, obtaining second samples of an intensity distribution of confounder objects, transforming the first and second samples into an appropriate first space, performing dimension reduction on the transformed first and second samples, whereby the dimension reduction of the transformed first and second samples generates an object detector, transforming one or more of the digital images into the first space, performing dimension reduction on the transformed digital images, whereby the dimension reduction of the transformed digital images generates one or more reduced images, classifying one or more pixels of the one or more reduced images based on a comparison with the object detector, and identifying one or more objects of interest from the classified pixels.

## Claims

### Claim 1

A system for diagnosing a disease condition in a patient, the system comprising:
one or more computer processors on one or more computers;
a computer readable medium on the one or more computers;
an object detection model stored on the computer readable medium, the object detection model comprising a set of parameters of a supervised procedure, wherein the object detection model is configured to output, based on an image, a probability that the image contains an object of interest at each of one or more locations within the image;
an automated diagnostic model stored on the computer readable medium, the automated diagnostic model comprising a set of parameters of a diagnostic model, wherein the automated diagnostic model is configured to output, based on the probability that the image contains the object of interest at each of one or more locations within the image, a probabilistic diagnosis of a disease condition depicted in the image; and
a diagnostic system stored on the computer readable medium, the diagnostic system containing instructions configured to cause the one or more computer processors to perform steps comprising:
receiving an input image of a portion of a body of the patient,
passing the input image to the object detection model,
receiving, from the object detection model, the probability that the input image contains the object of interest at each of the one or more locations within the input image,
passing, to the automated diagnostic model, the probability that the input image contains the object of interest at each of the one or more locations within the input image,
receiving, from the automated diagnostic model, the probabilistic diagnosis of the disease condition for the input image, and
outputting the probabilistic diagnosis of the disease condition.

### Claim 2 (depends on 1)

The system of claim 1, wherein passing the input image to the object detection model comprises:
obtaining one or more samples for each of a set of different regions of the input image; and
applying each of the one or more samples to the supervised procedure to output a probability that each of the one or more samples contains one or more objects of interest, where the one or more objects of interest are indicative of the disease condition.

### Claim 3 (depends on 1)

The system of claim 1, wherein the supervised procedure comprises a plurality of trained filters, each trained filter configured to identify the probability that the image contains the object of interest.

### Claim 4 (depends on 1)

The system of claim 1, wherein the input image passed to the object detection model is of a portion of an eye of the patient, and wherein the disease condition comprises a disorder manifesting in the eye.

### Claim 5 (depends on 1)

The system of claim 1, wherein the input image passed to the object detection model is of a portion of an eye of the patient, and wherein the disease condition comprises a disorder manifesting in a retina of the patient.

### Claim 6 (depends on 1)

The system of claim 1, wherein the object of interest at one of the one or more locations within the input image comprises an object that has a similar appearance to another object that indicates a disease condition in a patient but that does not itself indicate a disease condition in a patient.

### Claim 7 (depends on 1)

The system of claim 1, wherein the object of interest comprises an object selected from a group consisting of: a microaneurysm, a dot hemorrhage, a flame-shaped hemorrhage, a sub-intimal hemorrhage, a sub-retinal hemorrhage, a pre-retinal hemorrhage, a micro-infarction, a cotton-wool spot, a yellow exudate, and a drusen.

### Claim 8 (depends on 1)

The system of claim 1, wherein the supervised procedure is trained by a method comprising:
receiving a plurality of training examples, each training example comprising a training image and a label indicating whether the training image contains an object of interest at each of one or more locations within the training image; and
fitting the supervised procedure to the plurality of training examples.

### Claim 9 (depends on 8)

The system of claim 8, wherein the training image of at least one of the plurality of training examples is annotated to indicate one or more reference points that correspond to a center of a feature of interest in the training image.

### Claim 10 (depends on 1)

The system of claim 1, wherein the diagnostic model is trained by a method comprising:
receiving a plurality of training examples, each training example comprising a probability that a training image contains an object of interest at each of one or more locations within the training image and a label indicating whether the training image depicts a disease condition; and
fitting the diagnostic model to the plurality of training examples.

### Claim 11

A computer program product comprising a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by one or more computer processors on one or more computers, cause the one or more computer processors to perform steps comprising:
receiving an input image of a portion of a body of a patient;
accessing an object detection model, the object detection model comprising a set of parameters of a supervised procedure, wherein the object detection model is configured to output, based on an image, a probability that the image contains an object of interest at each of one or more locations within the image;
passing the input image to the object detection model;
receiving, from the object detection model, the probability that the input image contains the object of interest at each of the one or more locations within the input image;
accessing an automated diagnostic model, the automated diagnostic model comprising a set of parameters of a diagnostic model, wherein the automated diagnostic model is configured to output, based on the probability that an image contains the object of interest at each of one or more locations within the image, a probabilistic diagnosis of a disease condition depicted in the image;
passing, to the automated diagnostic model, the probability that the input image contains the object of interest at each of the one or more locations within the input image;
receiving, from the automated diagnostic model, the probabilistic diagnosis of the disease condition for the input image; and
outputting the probabilistic diagnosis of the disease condition.

### Claim 12 (depends on 11)

The computer program product of claim 11, wherein passing the input image to the object detection model comprises:
obtaining one or more samples for each of a set of different regions of the input image; and
applying each of the one or more samples to the supervised procedure to output a probability that each of the one or more samples contains one or more objects of interest, where the one or more objects of interest are indicative of the disease condition.

### Claim 13 (depends on 11)

The computer program product of claim 11, wherein the supervised procedure comprises a plurality of trained filters, each trained filter configured to identify the probability that the image contains the object of interest.

### Claim 14 (depends on 11)

The computer program product of claim 11, wherein the input image passed to the object detection model is of a portion of an eye of the patient, and wherein the disease condition comprises a disorder manifesting in the eye.

### Claim 15 (depends on 11)

The computer program product of claim 11, wherein the input image passed to the object detection model is of a portion of an eye of the patient, and wherein the disease condition comprises a disorder manifesting in a retina of the patient.

### Claim 16 (depends on 11)

The computer program product of claim 11, wherein the object of interest at one of the one or more locations within the input image comprises an object that has a similar appearance to another object that indicates a disease condition in a patient but that does not itself indicate a disease condition in a patient.

### Claim 17 (depends on 11)

The computer program product of claim 11, wherein the object of interest comprises an object selected from a group consisting of: a microaneurysm, a dot hemorrhage, a flame-shaped hemorrhage, a sub-intimal hemorrhage, a sub-retinal hemorrhage, a pre-retinal hemorrhage, a micro-infarction, a cotton-wool spot, a yellow exudate, and a drusen.

### Claim 18 (depends on 11)

The computer program product of claim 11, wherein the supervised procedure is trained by a method comprising:
receiving a plurality of training examples, each training example comprising a training image and a label indicating whether the training image contains an object of interest at each of one or more locations within the training image; and
fitting the supervised procedure to the plurality of training examples.

### Claim 19 (depends on 18)

The computer program product of claim 18, wherein the training image of at least one of the plurality of training examples is annotated to indicate one or more reference points that correspond to a center of a feature of interest in the training image.

### Claim 20 (depends on 11)

The computer program product of claim 11, wherein the diagnostic model is trained by a method comprising:
receiving a plurality of training examples, each training example comprising a probability that a training image contains an object of interest at each of one or more locations within the training image and a label indicating whether the training image depicts a disease condition; and
fitting the diagnostic model to the plurality of training examples.
