# US 12,191,040 B2 · Assessing disease risks from user captured images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,191,040 B2
- Document ID: US12191040B2
- Status: Granted
- Kind: B2
- Application number: 17/695,627
- Filed: 2022-03-15
- Published: 2022-09-22
- Granted: 2025-01-07
- Earliest claimed: 2021-03-16
- Assignees: Advanced Health Intelligence Ltd.
- Applicants: Advanced Human Intelligence Ltd.
- Inventors: Vlado Bosanac; Amar El-Sallam
- Web page: https://patentgrep.com/patent/US12191040B2

## CPC

- A61B 5/7275: {Determining trends in physiological measurement data; Predicting development of a medical condition based on physiological measurements, e.g. determining a risk factor}
- G16H 50/30: for calculating health indices; for individual health risk assessment
- A61B 5/0205: Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
- A61B 5/026: Measuring blood flow {(A61B3/1233, A61B3/1241 take precedence)}
- A61B 5/7267: {involving training the classification device}
- G06N 20/00: Machine learning
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- A61B 5/1079: {using optical or photographic means}
- A61B 2576/00: Medical imaging apparatus involving image processing or analysis (A61B1/00009, A61B6/52 and A61B8/52 take precedence)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

In some examples, an apparatus, such as a mobile phone can include an input module such as a touch screen, a camera, a processor, and computer readable medium. The camera captures one or more images of a person. The processor can use a single machine learning model to estimate the human body features of the person based on the captured images, and use the human body features to generate a disease risk assessment value associated with diabetes and cardiovascular disease risks. The human body features can include at least one or more of: 3D body shape, or body shape indicators; and one or more of: blood flow, blood pressure, heart rate, respiratory rate, heart rate variability, cardiac workload, irregular heartbeats, or stress index. The machine learning model can be trained over a set of training images.

## Claims

### Claim 1

An apparatus comprising:
an input data module configured to retrieve first input data and second input data;
a processor; and
a computer readable medium containing programming instructions that, when executed, will cause the processor to:
create a 3D body shape model from the first input data and the second input data, the 3D body shape model including biometrics;
extract biomarker data from the second input data;
use the biometrics and biomarker data to generate health risk indicators and assessments including a first disease risk assessment value;
generate a second risk assessment value based on the second input data; and
fuse the biometrics with the first and second input data, and optionally the first disease risk assessment value and the second disease risk assessment value to generate a multi-category disease risk assessment value.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the input data module is integrated with an image capturing device configured to capture one or more images of a subject.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the second input data includes the one or more images of the subject.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the first disease risk assessment value is based on the one or more images.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the first disease includes diabetes.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the second disease includes cardiovascular disease.

### Claim 7

An apparatus comprising:
an image capturing device configured to capture one or more images of a subject;
a processor; and
computer readable medium containing programming instructions that, when executed, will cause the processor to:
use a 3D body shape model to generate a diabetes risk assessment value based on the one or more images;
extract biomarker data from the one or more images;
use biomarker data to generate a cardiovascular risk assessment value based on the one or more images; and
fuse the diabetes risk assessment value and the cardiovascular risk assessment value to generate a disease risk assessment value.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the programming instructions are further configured to update the 3D body shape model based on an output of the fusion of the diabetes risk assessment value and the cardiovascular risk assessment value.

### Claim 9 (depends on 7)

The apparatus of claim 7, wherein the programming instructions are further configured to:
use the 3D body shape model to generate first biomarkers from the one or more images, the first biomarkers representing body features; and
generate the diabetes risk assessment value based on the body features.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the first biomarkers comprise one or more of: 3D body shapes or body shape indicators.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the diabetes risk assessment value indicates a risk associated with one or more of: type-2 diabetes, obesity, central obesity, or metabolic syndrome.

### Claim 12 (depends on 7)

The apparatus of claim 7, wherein the programming instructions are further configured to:
generate second biomarkers from the one or more images, the second biomarkers representing heart disease related biomarkers; and
generate the cardiovascular assessment value based on the second biomarkers.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the second biomarkers comprise one or more of: blood flow, blood pressure, heart rate, respiratory rate, heart rate variability, cardiac workload, irregular heartbeats, or stress index.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the cardiovascular risk assessment value indicates a risk associated with one or more of: cardiovascular disease, heart attack, or stroke.

### Claim 15 (depends on 12)

The apparatus of claim 12, wherein the programming instructions are further configured to generate the second biomarkers from facial images of the one or more images, wherein the second biomarkers comprise at least blood flow.

### Claim 16

An apparatus comprising:
an input data module configured to retrieve input data of a subject;
a processor; and
computer readable medium containing programming instructions that, when executed, will cause the processor to:
use a disease risk model to generate a human body feature from the input data; and
generate a disease risk assessment value based on the human body feature;
wherein the human body feature comprises at least:
one or more of: 3D body shape, or body shape indicators; and
one or more of: blood flow, blood pressure, heart rate, respiratory rate, heart rate variability, cardiac workload, irregular heartbeats, or stress index.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the disease risk assessment value indicates a risk associated with at least:
one or more of: type-2 diabetes, obesity, central obesity, or metabolic syndrome; and
one or more of: cardiovascular disease, heart attack, or stroke.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein the programming instructions are further configured to generate the disease risk model from one or more training images using a machine learning network.

### Claim 19 (depends on 16)

The apparatus of claim 16, wherein the input data module comprises an image capture device configured to capture one or more images of the subject.

### Claim 20 (depends on 19)

The apparatus of claim 19, wherein the input data comprises the one or more images of the subject.