# US 2022/0284572 A1 · Systems, methods, and devices for medical image analysis, diagnosis, risk stratification, decision making and/or disease tracking

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284572 A1
- Document ID: US20220284572A1
- Status: Published application
- Kind: A1
- Application number: 17/646,848
- Filed: 2022-01-03
- Published: 2022-09-08
- Earliest claimed: 2020-01-07
- Assignees: Cleerly, Inc.
- Applicants: Cleerly, Inc.
- Inventors: James K. MIN; James P. EARLS; Hugo Miguel RODRIGUES MARQUES
- Web page: https://patentgrep.com/patent/US20220284572A1

## CPC

- A61B 6/504: {for diagnosis of blood vessels, e.g. by angiography}
- A61B 5/0066: {Optical coherence imaging}
- A61B 5/0075: {by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy (A61B5/0071 takes precedence)}
- A61B 5/02007: {Evaluating blood vessel condition, e.g. elasticity, compliance}
- A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems}
- A61B 5/7267: {involving training the classification device}
- A61B 5/742: {using visual displays (displays for heart-related electrical signals, e.g. ECG, A61B5/339)}
- A61B 5/7475: {User input or interface means, e.g. keyboard, pointing device, joystick}
- A61B 6/032: {Transmission computed tomography [CT]}
- A61B 6/037: {Emission tomography}
- A61B 6/463: {characterised by displaying multiple images or images and diagnostic data on one display}
- A61B 6/467: {characterised by special input means}
- A61B 6/481: {involving the use of contrast agents}
- A61B 6/5205: {involving processing of raw data to produce diagnostic data}
- A61B 6/5217: {extracting a diagnostic or physiological parameter from medical diagnostic data}
- A61B 6/583: {using calibration phantoms}
- A61B 8/0891: {for diagnosis of blood vessels}
- A61B 8/12: in body cavities or body tracts, e.g. by using catheters
- A61B 8/14: Echotomography
- A61B 8/5223: {for extracting a diagnostic or physiological parameter from medical diagnostic data (for algorithms to analyse biomedical images G06T7/0012)}
- A61K 49/04: X-ray contrast preparations
- G06F 18/10: Pre-processing; Data cleansing
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06F 18/2413: based on distances to training or reference patterns
- G06T 7/0012: {Biomedical image inspection}
- G06V 10/20: Image preprocessing
- G06V 10/245: {by locating a pattern; Special marks for positioning}
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/82: using neural networks
- A61B 5/004: {adapted for image acquisition of a particular organ or body part (A61B5/0082 takes precedence; arrangements for optical scanning A61B5/0062)}
- A61B 5/1076: {for measuring dimensions inside body cavities, e.g. using catheters (A61B3/1005 takes precedence)}
- A61B 8/587: {Calibration phantoms}
- G06T 2207/10081: Computed x-ray tomography [CT]
- G06T 2207/10088: Magnetic resonance imaging [MRI]
- G06T 2207/10101: Optical tomography; Optical coherence tomography [OCT]
- G06T 2207/10104: Positron emission tomography [PET]
- G06T 2207/10108: Single photon emission computed tomography [SPECT]
- G06T 2207/10116: X-ray image
- G06T 2207/10132: Ultrasound image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20101: Interactive definition of point of interest, landmark or seed
- G06T 2207/30048: Heart; Cardiac
- G06T 2207/30101: Blood vessel; Artery; Vein; Vascular
- G06V 10/247: {by affine transforms, e.g. correction due to perspective effects; Quadrilaterals, e.g. trapezoids}
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- Y02A 90/10: Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- A61K: PREPARATIONS FOR MEDICAL, DENTAL OR TOILETRY PURPOSES (devices or methods specially adapted for bringing pharmaceutical products into particular physical or administering forms A61J3/00; chemical aspects of, or use of materials for deodorisation of air, for disinfection or sterilisation, or for bandages, dressings, absorbent pads or surgical articles A61L; soap compositions C11D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- Y02A: TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE

## Abstract

The disclosure herein relates to systems, methods, and devices for medical image analysis, diagnosis, risk stratification, decision making and/or disease tracking. In some embodiments, the systems, devices, and methods described herein are configured to analyze non-invasive medical images of a subject to automatically and/or dynamically identify one or more features, such as plaque and vessels, and/or derive one or more quantified plaque parameters, such as radiodensity, radiodensity composition, volume, radiodensity heterogeneity, geometry, location, and/or the like. In some embodiments, the systems, devices, and methods described herein are further configured to generate one or more assessments of plaque-based diseases from raw medical images using one or more of the identified features and/or quantified parameters.

## Claims

### Claim at position 1

-30. (canceled)

### Claim 31

A computer-implemented method for displaying computed tomography (CT) images and corresponding coronary vessel information including images rendered from the CT images and identification of lumen, vessel walls, and plaque of coronary vessels determined from the CT images by image processing, the method comprising:
accessing, by a computer system, a set of CT images of coronary vessels of a subject and coronary vessel information associated with the set of CT images, the coronary vessel information including identification of lumen, vessel walls, and plaque of one or more coronary vessels;
generating and displaying, by the computer system, in a user interface a first panel illustrating at least a portion of a coronary vessel of the subject in a plurality of straightened multiplanar (SMPR) vessel views comprising the coronary vessel information, the plurality of SMPR vessel views adjacently positioned to one another in the first panel, each of the plurality of SMPR vessel views rotationally offset from one another by a predetermined rotational angle along a longitudinal axis of the plurality of SMPR views;
generating and displaying, by the computer system, in the user interface a second panel showing a cross-sectional view of the portion of the coronary vessel comprising the coronary vessel information, the cross-sectional view generated using the set of CT images, wherein locations along the plurality of SMPR vessel views are associated with a CT image in the set of CT images such that a selection of a particular location along the portion of the coronary vessel in the plurality of SMPR vessel views displays the associated CT image in the cross-sectional view in the second panel;
receiving, by the computer system, a user input on the user interface indicating a location along the portion of the coronary vessel of the subject in the plurality of SMPR vessel views; and
in response to the user input, displaying, by the computer system, in the second panel the CT image in the set of CT images that is associated with the location along the portion of the coronary vessel in a cross-sectional view,
wherein the computer system comprises a computer processor and an electronic storage medium.

### Claim 32 (depends on 31)

The computer-implemented method of claim 31, wherein the plurality of SMPR views are rotatable by user input to provide a 360 degree view.

### Claim 33 (depends on 31)

The computer-implemented method of claim 31, wherein each the plurality of SMPR views are rotationally offset by 90 degrees.

### Claim 34 (depends on 31)

The computer-implemented method of claim 31, wherein the coronary vessel information is color-coded.

### Claim 35 (depends on 31)

The computer-implemented method of claim 31, further comprising generating and displaying, by the computer system, in the user interface a third panel illustrating a representation of coronary vessels, the representation of coronary vessels depicting coronary vessels identified in the set of CT images.

### Claim 36 (depends on 35)

The computer-implemented method of claim 35, wherein the representation of coronary vessels comprises an artery tree comprising a three-dimensional representation of coronary vessels, the artery tree depicting coronary vessels identified in the set of CT images.

### Claim 37 (depends on 36)

The computer-implemented method of claim 36, wherein the artery tree comprises one or more curved multiplanar reformat (CMPR) vessel views.

### Claim 38 (depends on 37)

The computer-implemented method of claim 37, wherein the one or more curved multiplanar reformat (CMPR) vessel views are configured to be rotatable by user input.

### Claim 39 (depends on 31)

The computer-implemented method of claim 31, further comprising:
generating and displaying, by the computer system, a lumen wall tool on the user interface;
receiving, by the computer system, a selection of the lumen wall tool; and
in response, graphically displaying, by the computer system, the lumen wall of the selected coronary vessel in one or more of the SMPR vessel views in the first panel or the cross-sectional view in the second panel,
wherein the lumen wall tool is configured to allow a user to adjust the displayed lumen wall in the SMPR vessel views in the first panel and the cross-sectional view in the second panel.

### Claim 40 (depends on 31)

The computer-implemented method of claim 31, further comprising:
generating and displaying, by the computer system, a vessel wall tool on the user interface;
receiving, by the computer system, a selection of the vessel wall tool; and
in response, graphically displaying, by the computer system, the vessel wall of the selected coronary vessel in one or more of the SMPR vessel views in the first panel or the cross-sectional view in the second panel,
wherein the vessel wall tool is configured to allow a user to adjust the displayed vessel wall in the SMPR vessel views in the first panel and the cross-sectional view in the second panel.

### Claim 41

A system for displaying computed tomography (CT) images and corresponding coronary vessel information including images rendered from the CT images and identification of lumen, vessel walls, and plaque of coronary vessels determined from the CT images by image processing, the system comprising:
one or more computer readable storage devices configured to store a plurality of computer executable instructions; and
one or more hardware computer processors in communication with the one or more computer readable storage devices and configured to execute the plurality of computer executable instructions in order to cause the system to:
access a set of CT images of coronary vessels of a subject and coronary vessel information associated with the set of CT images, the coronary vessel information including identification of lumen, vessel walls, and plaque of one or more coronary vessels;
generate and display in a user interface a first panel illustrating at least a portion of a coronary vessel of the subject in a plurality of straightened multiplanar (SMPR) vessel views comprising the coronary vessel information, the plurality of SMPR vessel views adjacently positioned to one another in the first panel, each of the plurality of SMPR vessel views rotationally offset from one another by a predetermined rotational angle along a longitudinal axis of the plurality of SMPR views;
generate and display in the user interface a second panel showing a cross-sectional view of the portion of the coronary vessel comprising the coronary vessel information, the cross-sectional view generated using the set of CT images, wherein locations along the plurality of SMPR vessel views are associated with a CT image in the set of CT images such that a selection of a particular location along the portion of the coronary vessel in the plurality of SMPR vessel views displays the associated CT image in the cross-sectional view in the second panel;
receive a user input on the user interface indicating a location along the portion of the coronary vessel of the subject in the plurality of SMPR vessel views; and
in response to the user input, display in the second panel the CT image in the set of CT images that is associated with the location along the portion of the coronary vessel in a cross-sectional view.

### Claim 42 (depends on 41)

The system of claim 41, wherein the plurality of SMPR views are rotatable by user input to provide a 360 degree view.

### Claim 43 (depends on 41)

The system of claim 41, wherein each the plurality of SMPR views are rotationally offset by 90 degrees.

### Claim 44 (depends on 41)

The system of claim 41, wherein the coronary vessel information is color-coded.

### Claim 45 (depends on 41)

The system of claim 41, further comprising generating and displaying, by the computer system, in the user interface a third panel illustrating a representation of coronary vessels, the representation of coronary vessels depicting coronary vessels identified in the set of CT images.

### Claim 46 (depends on 45)

The system of claim 45, wherein the representation of coronary vessels comprises an artery tree comprising a three-dimensional representation of coronary vessels, the artery tree depicting coronary vessels identified in the set of CT images.

### Claim 47 (depends on 46)

The system of claim 46, wherein the artery tree comprises one or more curved multiplanar reformat (CMPR) vessel views.

### Claim 48 (depends on 47)

The system of claim 47, wherein the one or more curved multiplanar reformat (CMPR) vessel views are configured to be rotatable by user input.

### Claim 49 (depends on 41)

The system of claim 41, wherein the system is further caused to:
generate and display a lumen wall tool on the user interface;
receive a selection of the lumen wall tool; and
in response, graphically display the lumen wall of the selected coronary vessel in one or more of the SMPR vessel views in the first panel or the cross-sectional view in the second panel,
wherein the lumen wall tool is configured to allow a user to adjust the displayed lumen wall in the SMPR vessel views in the first panel and the cross-sectional view in the second panel.

### Claim 50 (depends on 41)

The system of claim 41, wherein the system is further caused to:
generate and display a vessel wall tool on the user interface;
receive a selection of the vessel wall tool; and
in response, graphically display the vessel wall of the selected coronary vessel in one or more of the SMPR vessel views in the first panel or the cross-sectional view in the second panel,
wherein the vessel wall tool is configured to allow a user to adjust the displayed vessel wall in the SMPR vessel views in the first panel and the cross-sectional view in the second panel.