# US 12,118,725 B2 · Analyzing image data to determine bowel preparation quality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,118,725 B2
- Document ID: US12118725B2
- Status: Granted
- Kind: B2
- Application number: 17/310,686
- Filed: 2020-02-14
- Published: 2022-03-10
- Granted: 2024-10-15
- Earliest claimed: 2019-02-18
- Assignees: The Johns Hopkins University
- Applicants: The Johns Hopkins University
- Inventors: Simon C. Mathews; Amit Banerjee; Jay Pasricha
- Web page: https://patentgrep.com/patent/US12118725B2

## CPC

- G06T 7/0014: {using an image reference approach}
- G16H 20/10: relating to drugs or medications, e.g. for ensuring correct administration to patients
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/30: for calculating health indices; for individual health risk assessment
- G06T 2207/30004: Biomedical image processing
- G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

An analyzing platform may obtain a first image of a liquid in a receptacle. The analyzing platform may analyze the first image to determine a first set of visual characteristics concerning the liquid. The analyzing platform may obtain a second image of a rectal sample in the liquid in the receptacle, wherein the rectal sample originated from a bowel of a subject. The analyzing platform may analyze the second image to determine a second set of visual characteristics concerning the rectal sample. The analyzing platform may determine, based on the first set of visual characteristics and the second set of visual characteristics, rectal sample information. The analyzing platform may cause one or more actions to be performed based on the rectal sample information.

## Claims

### Claim 1

A device, comprising:
one or more memories; and
one or more processors, communicatively coupled to the one or more memories, configured to:
obtain, before a rectal sample is deposited in a liquid in a receptacle, a first image of the liquid in the receptacle,
wherein the rectal sample is associated with at least an animal or a human;
analyze the first image to determine a first characteristic associated with the liquid in the receptacle;
obtain a second image of the rectal sample in the liquid in the receptacle;
analyze the second image to determine a second characteristic associated with the rectal sample;
determine, based on the first characteristics and the second characteristic, one or more estimated biochemical measurements associated with the rectal sample; and
cause one or more actions to be performed based on the one or more estimated biochemical measurements associated with the rectal sample.

### Claim 2 (depends on 1)

The device of claim 1, wherein the one or more estimated biochemical measurements associated with the rectal sample includes at least one of:
an estimated hemoglobin measurement associated with the rectal sample;
an estimated protein measurement associated with the rectal sample;
an estimated fat measurement associated with the rectal sample;
an estimated carbohydrate measurement associated with the rectal sample;
an estimated nucleic acid measurement associated with the rectal sample; or
an estimated acidity measurement associated with the rectal sample.

### Claim 3 (depends on 1)

The device of claim 1, wherein the one or more processors, when analyzing the second image to determine the second characteristic, are to:
analyze image data associated with an area of the second image to determine the second characteristic.

### Claim 4 (depends on 1)

The device of claim 1, wherein the second characteristic is a spectral feature associated with the rectal sample.

### Claim 5 (depends on 1)

The device of claim 1, wherein the one or more processors, when determining the one or more estimated biochemical measurements associated with the rectal sample, are configured to:
determine, using at least one machine learning model, and based on the first characteristic and the second characteristic, the one or more estimated biochemical measurements associated with the rectal sample.

### Claim 6 (depends on 1)

The device of claim 1, wherein the one or more processors, when causing the one or more actions to be performed, are configured to:
send the one or more estimated biochemical measurements associated with the rectal sample to a user device to cause the user device to display the one or more estimated biochemical measurements associated with the rectal sample on a display of the user device.

### Claim 7 (depends on 1)

The device of claim 1, wherein the one or more processors, when causing the one or more actions to be performed, are configured to:
determine, based on the one or more estimated biochemical measurements associated with the rectal sample, an estimated health condition of a subject associated with the rectal sample.

### Claim 8 (depends on 7)

The device of claim 7, wherein the estimated health condition indicates at least one of:
whether the subject has a gastrointestinal disease;
whether the subject is at risk of developing a gastrointestinal disease;
whether the subject is anemic; or
whether the subject is dehydrated.

### Claim 9

A non-transitory computer-readable medium storing instructions, the instructions comprising:
one or more instructions that, when executed by one or more processors of a user device, cause the one or more processors to:
obtain, before a bodily fluid is deposited in a liquid in a receptacle, a first image of the liquid in the receptacle,
wherein the bodily fluid is associated with at least an animal or a human;
analyze the first image to determine a first set of characteristics associated with the bodily fluid;
obtain a second image of the bodily fluid in the liquid in the receptacle;
analyze the second image to determine a second set of characteristics associated with the bodily fluid;
determine, based on the first set of characteristics and the second set of characteristics, one or more estimated biochemical measurements associated with the bodily fluid; and
cause one or more actions to be performed based on the one or more estimated biochemical measurements associated with the bodily fluid.

### Claim 10 (depends on 9)

The non-transitory computer-readable medium of claim 9, wherein the bodily fluid includes at least one of:
a rectal sample;
urine;
sputum; or
mucus.

### Claim 11 (depends on 9)

The non-transitory computer-readable medium of claim 9, wherein a camera device of the user device is configured to obtain the image of the bodily fluid,
wherein the camera device is configured to capture hyperspectral images.

### Claim 12 (depends on 9)

The non-transitory computer-readable medium of claim 9, wherein the second set of characteristics includes a spectral feature associated with the bodily fluid.

### Claim 13

A method, comprising:
obtaining, by a device and before a rectal sample is deposited in a liquid in a receptacle, a first image of the liquid in the receptacle,
wherein the rectal sample is associated with at least an animal or a human;
analyzing, by the device, the first image to determine a first set of characteristics concerning the liquid;
obtaining, by the device, a second image of the rectal sample in the liquid in the receptacle,
wherein the rectal sample originated from a bowel of a subject;
analyzing, by the device, the second image to determine a second set of characteristics concerning the rectal sample;
determining, by the device and based on the first set of characteristics and the second set of characteristics, an estimated hemoglobin measurement associated with the rectal sample; and
causing, by the device, one or more actions to be performed based on the estimated hemoglobin measurement associated with the rectal sample.

### Claim 14 (depends on 13)

The method of claim 13, wherein analyzing the first image to determine the first set of characteristics further comprises:
determining a first area of the first image associated with the liquid; and
analyzing image data of the first area to determine a spectral feature associated with the liquid,
wherein analyzing the second image to determine the second set of characteristics further comprises:
determining a second area of the second image associated with the rectal sample in the liquid, and
analyzing image data of the second area to determine a spectral feature associated with the rectal sample.

### Claim 15 (depends on 13)

The method of claim 13, wherein determining the estimated hemoglobin measurement associated with the rectal sample comprises:
comparing, based on the first set of characteristics and the second set of characteristics, a spectral feature associated with the liquid and a spectral feature associated with the rectal sample to determine the estimated hemoglobin measurement associated with the rectal sample.

### Claim 16 (depends on 13)

The method of claim 13, wherein determining the estimated hemoglobin measurement associated with the rectal sample comprises:
determining, using a colorimetric processing technique and based on the first set of characteristics and the second set of characteristics, the estimated hemoglobin measurement associated with the rectal sample.

### Claim 17 (depends on 13)

The method of claim 13, wherein determining the estimated hemoglobin measurement associated with the rectal sample comprises:
determining, using at least one machine learning model and based on the first set of characteristics and the second set of characteristics, the estimated hemoglobin measurement associated with the rectal sample.

### Claim 18 (depends on 13)

The method of claim 13, wherein causing the one or more actions to be performed comprises:
causing a user device to display the estimated hemoglobin measurement associated with the rectal sample on a display of the user device.

### Claim 19 (depends on 13)

The method of claim 13, wherein causing the one or more actions to be performed comprises:
determining that the estimated hemoglobin measurement associated with the rectal sample is outside a particular range;
determining, based on determining that the estimated hemoglobin measurement associated with the rectal sample is outside the particular range, an estimated health condition of the subject; and
causing, based on the estimated health condition of the subject, a different device to schedule an appointment time for at least one of the following:
a bowel screening procedure,
a blood test, or
a physical examination of the subject.

### Claim 20 (depends on 19)

The method of claim 19, wherein the estimated health condition indicates whether the subject is anemic.
