# US 2025/0157034 A1 · Content based image retrieval for lesion analysis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0157034 A1
- Document ID: US20250157034A1
- Status: Published application
- Kind: A1
- Application number: 19/025,964
- Filed: 2025-01-16
- Published: 2025-05-15
- Earliest claimed: 2017-11-22
- Assignees: Arterys Inc.
- Applicants: Arterys Inc.
- Inventors: Daniel Irving GOLDEN; Fabien Rafael David BECKERS; John AXERIO-CILIES; Matthieu LE; Jesse LIEMAN-SIFRY; Anitha Priya KRISHNAN; Sean Patrick SALL; Hok Kan LAU; Matthew Joseph DIDONATO; Robert George NEWTON; Torin Arni TAERUM; Shek Bun LAW; Carla Rosa LEIBOWITZ; Angélique Sophie CALMON
- Web page: https://patentgrep.com/patent/US20250157034A1

## CPC

- G06T 7/0012: {Biomedical image inspection}
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G06N 3/0985: Hyperparameter optimisation; Meta-learning; Learning-to-learn
- G06T 7/11: Region-based segmentation
- G06T 7/143: involving probabilistic approaches, e.g. Markov random field [MRF] modelling
- G06T 7/194: involving foreground-background segmentation
- G06V 10/82: using neural networks
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G16H 20/10: relating to drugs or medications, e.g. for ensuring correct administration to patients
- G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- G16H 70/20: relating to practices or guidelines
- G06T 2207/10081: Computed x-ray tomography [CT]
- G06T 2207/10088: Magnetic resonance imaging [MRI]
- G06T 2207/20036: Morphological image processing
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/20152: Watershed segmentation
- G06T 2207/30056: Liver; Hepatic
- G06T 2207/30064: Lung nodule
- G06T 2207/30096: Tumor; Lesion
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) are commonly used to assess patients with known or suspected pathologies of the lungs and liver. In particular, identification and quantification of possibly malignant regions identified in these high-resolution images is essential for accurate and timely diagnosis. However, careful quantitative assessment of lung and liver lesions is tedious and time consuming. This disclosure describes an automated end-to-end pipeline for accurate lesion detection and segmentation.

## Claims

### Claim at position 1

1-197. (canceled)

### Claim 198

A machine learning system, comprising:
at least one nontransitory processor-readable storage medium that stores at least one of processor-executable instructions or data; and
at least one processor communicably coupled to the at least one nontransitory processor-readable storage medium, in operation the at least one processor:
detects lesions in image data using one or more previously trained detection machine learning models;
quantifies information about the lesions using one or more previously trained quantification machine learning models;
stores the quantified information in a database; and
responsive to interaction by a user via a user interface, reveals the stored quantified information to the user.

### Claim at position 3

199-202. (canceled)

### Claim 203 (depends on 198)

The machine learning system of claim 198 wherein one or more of the detection machine learning models is of a convolutional neural network (CNN), wherein the detection machine learning model comprises at least a first CNN and a second CNN that follows the first CNN, wherein the first CNN localizes prospective lesions and the second CNN classifies the localized prospective lesions.

### Claim 204

(canceled)

### Claim 205 (depends on 198)

The machine learning system of claim 198 wherein at least one of the quantification machine learning models is a CNN model that segments the lesions.

### Claim 206 (depends on 205)

The machine learning system of claim 205 wherein at least one CNN model comprises a contracting path and an expanding path, the contracting path includes a number of convolutional layers and a number of pooling layers, each pooling layer preceded by at least one convolutional layer, and the expanding path includes a number of convolutional layers and a number of upsampling layers, each upsampling layer preceded by at least one convolutional layer and comprises a transpose convolution operation which performs upsampling and interpolation with a learned kernel.

### Claim 207

(canceled)

### Claim 208 (depends on 231)

The method of claim 231, wherein at least one of the one or more quantification machine learning models is a CNN model that classifies characteristics of the lesions.

### Claim 209 (depends on 208)

The method of claim 208, wherein at least one CNN model classifies features of the lesions, including one or more of size, shape, margin, opacity or heterogeneity.

### Claim 210 (depends on 208)

The method of claim 208, wherein at least one CNN model classifies features external to the lesions.

### Claim 211 (depends on 210)

The method of claim 210, wherein the features external to the lesions include one or more of location within the body, relationship to surrounding lesions or tissue properties surrounding the lesion.

### Claim at position 13

212-215. (canceled)

### Claim 216 (depends on 231)

The method of claim 231, wherein the user interaction includes an interaction with a lesion in order to reveal information about the given lesion.

### Claim 217 (depends on 216)

The method of claim 216, wherein the interaction includes at least one of a click or tap within a pre-generated segmentation mask, a mouseover of a pre-generated segmentation mask, or a click-and-drag selection surrounding at least a part of a pre-generated segmentation mask.

### Claim 218

(canceled)

### Claim 219

(canceled)

### Claim 220 (depends on 231)

The method of claim 231, comprising: responsive to multiple series of image data being available for the same patient; and responsive to user interaction on a single series, revealing information for one or more of the multiple series.

### Claim 221 (depends on 220)

The method of claim 220, comprising revealing segmentations and classifications for a lesion on an optimal series of image data.

### Claim 222 (depends on 221)

The method of claim 221, comprising determining that a series is optimal based on at least one of (a) the clinical relevance of the series to diagnosis or management or (b) the accuracy with which the quantification machine learning model is able to quantify the lesion.

### Claim 223

(canceled)

### Claim 224 (depends on 220)

The method of claim 220, comprising determining the segmentations and classifications for a lesion on any given series based at least in part on information from one or more series.

### Claim 225 (depends on 224)

The method of claim 224, comprising determining the segmentations and classifications based at least in part on consensus of the segmentation or classification from each series.

### Claim 226 (depends on 220)

The method of claim 220, comprising revealing one or more of segmentations or classifications for a lesion on one or more series of image data.

### Claim 227 (depends on 226)

The method of claim 226, comprising performing at least one of (a) recalculating one or more of the segmentations or classifications independently on each series of the image data or (b) copying one or more of the segmentations or classifications from the optimal series of image data to each other series.

### Claim 228

(canceled)

### Claim 229

(canceled)

### Claim 230 (depends on 317)

The non-transitory computer-readable medium of claim 317, wherein the acts comprise, responsive to a user interaction occurring at a region not previously determined to be a lesion by the previously trained detection machine learning model, calculating segmentations and classifications in real time.

### Claim 231

A processor-based method, comprising:
detecting lesions in image data using one or more previously trained detection machine learning models;
quantifying information about the lesions using one or more previously trained quantification machine learning models:
storing the quantified information in a database; and
responsive to interaction by a user via a user interface, revealing the stored quantified information to the user.

### Claim at position 30

232-316. (canceled)

### Claim 317

A non-transitory computer-readable medium storing contents that, when executed by one or more processors, cause acts to be performed, the acts comprising:
detecting lesions in image data using one or more previously trained detection machine learning models;
quantifying information about the lesions using one or more previously trained quantification machine learning models;
storing the quantified information in a database; and
responsive to interaction by a user via a user interface, revealing the stored quantified information to the user.
