# US 2021/0265059 A1 · Method and system for characterizing stool patterns of young infants

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0265059 A1
- Document ID: US20210265059A1
- Status: Published application
- Kind: A1
- Application number: 17/253,130
- Filed: 2019-05-28
- Published: 2021-08-26
- Earliest claimed: 2018-06-21
- Assignees: N.V. Nutricia
- Applicants: N.V. Nutricia
- Inventors: Damien Luc Dominique Marie Paineau; Agathe Camille Foussat; Thomas Ludwig; Inès Oukid
- Web page: https://patentgrep.com/patent/US20210265059A1

## CPC

- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- A61B 5/0013: {Medical image data (A61B1/00011, A61B6/56, A61B8/56 take precedence)}
- A61B 5/0022: {Monitoring a patient using a global network, e.g. telephone networks, internet}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/48: {Other medical applications}
- A61B 5/7267: {involving training the classification device}
- A61B 5/742: {using visual displays (displays for heart-related electrical signals, e.g. ECG, A61B5/339)}
- G06T 7/0004: {Industrial image inspection}
- G06T 7/0012: {Biomedical image inspection}
- G16H 50/30: for calculating health indices; for individual health risk assessment
- G06T 2207/10024: Color image
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30004: Biomedical image processing
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The invention provides a method of analysing the consistency of stool, including the steps of: providing stool of an infant, capturing, with a portable device comprising a camera, an image of the stool, providing the captured image to an input layer of a pre-trained convolutional neural network, CNN, processing the captured image using the CNN to obtain, from a final layer of the CNN, a classification vector and to obtain information about a predicted score from the classification vector, wherein at least the final layer of the CNN has been customized so that each element of the classification vector corresponds to a score of a stool analysis scale, and storing information about the predicted store.

## Claims

### Claim 1

A computer-implemented method of analysing the consistency of stool, comprising the steps of:
providing stool of an infant,
capturing, with a portable device comprising a camera, an image of the stool,
providing the captured image to an input layer of a pre-trained convolutional neural network, CNN;
processing the captured image using the CNN to obtain, from a final layer of the CNN, a classification vector and to obtain information about a predicted score from the classification vector;
wherein at least the final layer of the CNN has been customized so that each element of the classification vector corresponds to a respective score of a stool analysis scale, and
storing information about the predicted score,
wherein the image is a colour image and wherein the method further comprises automatically detecting the colour of the stool and analysing the colour to provide additional information.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the stool is provided in an open diaper.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the stool is provided in a potty, a bed pan, a toilet chair or a toilet with plateaus.

### Claim 4 (depends on 1)

The method according to claim 1, further comprising displaying, by the portable device, guiding information to meet predetermined conditions before capturing the image.

### Claim 5 (depends on 1)

The method according to claim 1, wherein capturing the image comprises automatically capturing the image by the portable device when predetermined conditions are met.

### Claim 6 (depends on 4)

The method according to claim 4, wherein the predetermined conditions comprise at least one of a condition that the stool is placed on a surface with a regular background or a condition that the stool is the only object present in the image.

### Claim 7

(canceled)

### Claim 8 (depends on 2)

The method according to claim 2, wherein the predetermined conditions comprise at least one of a condition that the diaper is placed on a surface with a regular background or a condition that the diaper is the only object present in the image.

### Claim 9

(canceled)

### Claim 10 (depends on 1)

The method according to claim 1, wherein the information about the predicted score comprises at least one of the predicted score, the captured image of the stool, and the date and/or time at which the image was captured.

### Claim 11 (depends on 1)

The method according to claim 1, wherein processing the captured image using the CNN is performed by the portable device.

### Claim 12 (depends on 1)

The method according to claim 1, wherein processing the captured image using the CNN is performed by a server communicating with the portable device.

### Claim 13 (depends on 1)

The method according to claim 1, wherein the information about the predicted score is stored in at least one of the portable device or a server communicating with the portable device.

### Claim 14

(canceled)

### Claim 15 (depends on 1)

The method according to claim 1, further comprising analysing a frequency in which the stool is produced, based on stored time information related to the predicted scores for a plurality of captured images.

### Claim 16

System for analysing the consistency of stool, comprising:
a portable device comprising:
a camera configured to capture an image of stool of an infant,
a controller configured to
provide the captured image to an input layer of a pre-trained convolutional neural network, CNN,
obtain from a final layer of the CNN, a classification vector; wherein at least the final layer of the CNN has been customized so that each element of the classification vector corresponds to a respective score of a stool analysis scale, and
obtain information about a predicted score from the classification vector, and
a memory for storing the information about the predicted score,
wherein the image is a colour image and wherein the method further comprises automatically detecting the colour of the stool and analysing the colour to provide additional information.

### Claim 17 (depends on 16)

The system according to claim 16, wherein the stool is provided in an open diaper.

### Claim 18 (depends on 16)

The system according to claim 16, wherein the stool is provided in a potty, a bed pan, a toilet chair, or a toilet with plateaus.

### Claim 19 (depends on 16)

The method according to claim 16, wherein the information about the predicted score comprises at least one of the predicted score, the captured image of the stool, and the date and/or time at which the image was captured.

### Claim 20 (depends on 16)

The system according to claim 16, further comprising a server for communicating with the portable device, wherein the server is configured to store the information about the predicted score.

### Claim 21 (depends on 16)

The system according to claim 16, wherein processing the captured image using the CNN to obtain the classification vector from a final layer of the CNN is performed by the portable device.

### Claim 22 (depends on 16)

The system according to claim 16,
wherein the server is further configured to process the captured image using the CNN to obtain the classification vector from a final layer of the CNN, and
wherein the portable device is further configured to transmit the captured image to the server and to receive the predicted score from the server.

### Claim 23

(canceled)

### Claim 24 (depends on 1)

Computer program product for analysing the consistency of stool, comprising:
a non-transitory computer readable medium comprising codes executable by at least one processor to execute a method according to claim 1.
