# US 2020/0395124 A1 · System and method for patient monitoring of gastrointestinal function using automated stool classifications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0395124 A1
- Document ID: US20200395124A1
- Status: Published application
- Kind: A1
- Application number: 16/899,870
- Filed: 2020-06-12
- Published: 2020-12-17
- Earliest claimed: 2019-06-12
- Assignees: HealthMode, Inc.
- Applicants: HealthMode, Inc.
- Inventors: Daniel R. Karlin; Peter Dubec; Martin Majernik; Vladimir Boza; Lucia Kvapilova; Dana Rajtarova
- Web page: https://patentgrep.com/patent/US20200395124A1

## CPC

- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- A61B 5/42: {Detecting, measuring or recording for evaluating the gastrointestinal, the endocrine or the exocrine systems (A61B1/00, A61B5/4857, A61B5/486, A61B5/4866, A61B5/4869 take precedence)}
- A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems}
- G06T 7/0012: {Biomedical image inspection}
- G16H 30/40: for processing medical images, e.g. editing
- A61B 5/4255: {Intestines, colon or appendix}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10024: Color image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30092: Stomach; Gastric
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method of data collection of stool data via a mobile device operable to enable monitoring of gastrointestinal function. A related method of long-term monitoring of patient gastrointestinal function, using one or more signal processing tools (e.g. machine learning algorithms) for automatically interpreting patient stool data, including real-time patient-assessments, in order to detect an adverse clinical event from patient stool data. A system for facilitating real-time monitoring the gastrointestinal function, the system comprising: a camera on a mobile device, a user interface that facilitates self-monitoring of stool characteristics, so as to create health-monitoring data; mobile device storage, server storage, and remote storage (with at least one communication link between them) for storing some or all of the health-monitoring data; and a processor for interpreting such health-monitoring data for clinical or other health-monitoring application.

## Claims

### Claim 1

A method of facilitating data collection of stool data associated with a digital image of a stool sample, where the digital image is captured by a mobile device comprising a camera, a processor, and memory, the method comprising:
providing computer-readable code to the mobile device which, when executing on the mobile device,
enables automated editing of color in the digital image to create a color-edited image,
enables user-entry of at least one stool assessment to create at least one annotation associated with the digital image using the color-edited image, and
enables the mobile device to store the at least one annotation in the memory.

### Claim 2 (depends on 1)

The method of claim 1, wherein the color-edited image is created using an automated color-inversion process.

### Claim 3 (depends on 2)

The method of claim 2, wherein at least one annotation is associated with the digital image in real-time.

### Claim 4 (depends on 1)

The method of claim 1, wherein the at least one annotation comprises at least one subjective annotation associated with the stool sample.

### Claim 5 (depends on 4)

The method of claim 4, further comprising uploading the at least one annotation to a patient database so as to enable patient monitoring of gastrointestinal function over time.

### Claim 6 (depends on 1)

The method of claim 1, wherein the at least one annotation comprises a stool scale classification.

### Claim 7 (depends on 6)

The method of claim 6, wherein the stool scale classification is based on a Bristol Stool Chart.

### Claim 8 (depends on 1)

The method of claim 1, further comprising providing computer-readable code to the mobile device which, when executing on the mobile device, enables the mobile device to upload the digital image to a server.

### Claim 9 (depends on 8)

The method of claim 8, wherein the server comprises a cloud-based storage.

### Claim 10

A computerized method of long-term monitoring of patient gastrointestinal function, the computerized method comprising:
obtaining a digital image of a stool sample;
classifying the digital image, using a signal processing tool, to obtain a classified digital image;
annotating the classified digital image with patient-assessed information, to obtain at least one subjective annotation associated with the classified digital image of the stool sample;
storing the at least one subjective annotation associated with the classified digital image in a database of stool monitoring information; and
interpreting the database of stool monitoring information.

### Claim 11 (depends on 10)

The method of claim 10, wherein the signal processing tool includes a machine learning algorithm comprising a stool ID from noise model.

### Claim 12 (depends on 10)

The method of claim 10, wherein the signal processing tool includes a machine learning algorithm comprising a stool color classifier model.

### Claim 13 (depends on 10)

The method of claim 10, wherein the signal processing tool includes a machine learning algorithm comprising a stool size classifier model.

### Claim 14 (depends on 10)

The method of claim 10, wherein the signal processing tool includes a machine learning algorithm comprising a stool texture classifier model.

### Claim 15 (depends on 10)

The method of claim 10, wherein the signal processing tool includes a machine learning algorithm comprising a stool float classifier model.

### Claim 16 (depends on 10)

The method of claim 10, wherein the signal processing tool includes a machine learning algorithm comprising a frequency and cadence classifier model.

### Claim 17

A system for real-time monitoring of gastrointestinal function for clinical application, the system comprising:
a mobile device comprising a camera, a processor, and device memory, wherein the mobile device is programmed to capture medical image data relating to a patient stool,
process the medical image data to create a color-edited image,
provide a user interface to enable entry of at least one stool assessment to create at least one annotation to the medical image data using the color-edited image, and
store the at least one annotation and the medical image data, so as to enable creation of at least one set of clinical data associated with the medical image data;
a server comprising server memory operable to store the at least one set of clinical data in a database; and
a communication link between the mobile device and the server, wherein the mobile device is further programmed to enable uploading over the communication link the at least one set of clinical data from the mobile device to the server.

### Claim 18 (depends on 17)

The system of claim 17, wherein the color-edited image is created by an automated color-inversion process.

### Claim 19 (depends on 17)

The system of claim 17, wherein the server further comprises a server processor, wherein the server processor is programmed to
execute a signal processing tool operable to classify the at least one set of clinical data into a classified clinical dataset, and
store the classified clinical dataset in a second database in the server memory.

### Claim 20 (depends on 19)

The system of claim 19, further comprising:
a data structure comprising a clinical diagnostic tree stored in the server memory, and
a plurality of adverse clinical events stored in a third database in the server memory, and
wherein the server processor is further programmed to interpret the classified clinical dataset using the clinical diagnostic tree and the third database.

### Claim 21 (depends on 20)

The system of claim 20, wherein said server comprises a first server comprising a first processor and a first server memory, a second server comprising a second server processor and a second server memory, and a third server comprising a third server processor and a third server memory, wherein
the at least one set of clinical data is stored in the first server memory,
the second database is stored in the second server memory,
the clinical diagnostic tree is stored in the third server memory, and
the third database is stored in the third server memory.

### Claim 22

A computer program product comprising:
A memory including computer-readable code stored therein,
wherein the computer-readable code, when executed on a mobile computing device,
causes the mobile computing device to
create a digital image of a stool sample,
edit color in the digital image using an automated color-inversion process to create a color-edited image,
create a set of annotations associated with the digital image and the color-edited image, and
store the set of annotations in a memory of the mobile computing device.

### Claim 23 (depends on 22)

The computer program product of claim 22, wherein the computer-readable code further causes the mobile computing device to upload the set of annotations to a storage device.

### Claim 24 (depends on 23)

The computer program product of claim 23, wherein the computer-readable code further causes the mobile computing device to upload the digital image to a second storage device.
