# US 2023/0410315 A1 · Deep magnetic resonance fingerprinting auto-segmentation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410315 A1
- Document ID: US20230410315A1
- Status: Published application
- Kind: A1
- Application number: 18/250,955
- Filed: 2021-10-25
- Published: 2023-12-21
- Earliest claimed: 2020-10-28
- Applicants: Memorial Sloan Kettering Cancer Center
- Inventors: Ouri Cohen; Ricardo Otazo; Harini Veeraraghavan
- Web page: https://patentgrep.com/patent/US20230410315A1

## CPC

- G01R 33/5608: {Data processing and visualization specially adapted for MR, e.g. for feature analysis and pattern recognition on the basis of measured MR data, segmentation of measured MR data, edge contour detection on the basis of measured MR data, for enhancing measured MR data in terms of signal-to-noise ratio by means of noise filtering or apodization, for enhancing measured MR data in terms of resolution by means for deblurring, windowing, zero filling, or generation of gray-scaled images, colour-coded images or images displaying vectors instead of pixels (image data processing or generation, in general G06T)}
- G06T 7/11: Region-based segmentation
- G06N 3/045: Combinations of networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/047: Probabilistic or stochastic networks
- G06N 3/0475: Generative networks
- G06N 3/088: Non-supervised learning, e.g. competitive learning
- G06N 3/0895: Weakly supervised learning, e.g. semi-supervised or self-supervised learning
- G06N 3/09: Supervised learning
- G06N 3/094: Adversarial learning
- G06N 20/00: Machine learning
- G06T 7/0012: {Biomedical image inspection}
- G06V 10/26: Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V 10/82: using neural networks
- G01R 33/50: based on the determination of relaxation times {, e.g. T1 measurement by IR sequences; T2 measurement by multiple-echo sequences}
- G01R 33/561: by reduction of the scanning time, i.e. fast acquiring systems, e.g. using echo-planar pulse sequences
- G06T 2207/10088: Magnetic resonance imaging [MRI]
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06V 2201/031: of internal organs
- G01R: MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES (indicating correct tuning of resonant circuits H03J3/12)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems and methods are provided for predictive volumetric and structural evaluation of petroleum product containers. The system includes a computing device in communication with data input devices and implementation tools including calibration devices for measuring tank volume among other physical parameters bearing on tank volume. The computing device receives sets of historical physical parameter data for a plurality of tanks and, using machine learning (ML), generates predictive ML models for estimating volumetric parameters of tanks. The predictive model is applied by the system to historical and current data values to estimate current volumetric parameters for a given tank and, based on the results, the system performs or coordinates further operations for the given tank using an implementation tool. The further opera ions can include inventory management, physical calibration, maintenance and inspection as well as system evaluation and control operations.

## Claims

### Claim 1

A method of training models to segment tomographic biomedical images, comprising:
identifying, by a computing system, a training dataset having: a plurality of sample tomographic biomedical images acquired from a section of a subject, a plurality of tissue parameters associated with the section of the subject, and an annotation identifying at least one region on the section in at least one of the plurality of sample tomographic biomedical images;
training, by the computing system, an image segmentation model using the training dataset, the image segmentation model comprising:
a generator to determine a plurality of acquisition parameters using the plurality of sample tomographic biomedical images, the plurality of acquisition parameters defining an acquisition of the plurality of sample tomographic biomedical images from the section of the subject;
an image synthesizer to generate a plurality of synthesized tomographic biomedical images in accordance with the plurality of tissue parameters and the plurality of acquisition parameters;
a discriminator to determine a classification result indicating whether an input tomographic biomedical image corresponding to one of the plurality of sample tomographic biomedical image or the plurality of synthesized tomographic biomedical images is synthesized; and
a segmentor to generate, using the input tomographic biomedical image, a segmented biomedical image identifying the at least one region in the section of the subject; and
storing, by the computing system, the image segmentation model for use to identify one or more regions of interest in tomographic biomedical images.

### Claim 2 (depends on 1)

The method of claim 1, wherein training the image segmentation model further comprises:
determining a segmentation loss metric based on the segmented tomographic biomedical image and the annotation; and
updating one or more parameters of at least one of the generator, the discriminator, and the segmentor of the image segmentation model using the segmentation loss metric.

### Claim 3 (depends on 1)

The method of claim 1, wherein training the image segmentation model further comprises:
determining a matching loss metric based on the plurality of sample tomographic biomedical image and the corresponding plurality of synthesized tomographic biomedical image; and
updating one or more parameters of at least one of the generator, the discriminator, and the segmentor of the image segmentation model using the matching loss metric.

### Claim 4 (depends on 1)

The method of claim 1, wherein training the image segmentation model further comprises updating one or more parameters of at least one of the generator and the discriminator using a loss metric associated with the segmentor.

### Claim 5 (depends on 1)

The method of claim 1, wherein storing the image segmentation model further comprises providing, responsive to training of the image segmentation model, the plurality of acquisition parameters for acquisition of the tomographic biomedical images, the plurality of acquisition parameters identifying at least one of a flip angle (FA), a repetition time (TR), or an echo time (TE).

### Claim 6 (depends on 1)

The method of claim 1, wherein the segmentor of the image segmentation model comprises a plurality of residual layers corresponding to a plurality of resolutions to generate the segmented tomographic biomedical image, each of the plurality of residual layers having one or more residual connection units (RCUs) to process at least one feature map for a corresponding resolution of the plurality of resolutions.

### Claim 7 (depends on 1)

The method of claim 1, wherein each of the plurality of sample tomographic biomedical images is acquired from the section of the subject in vivo via magnetic resonance imaging, the plurality of tissue parameters identifying at least one of proton density (PD), a longitudinal relaxation time (T1), or a transverse relaxation time (T2) for the acquisition of the plurality of sample tomographic biomedical images.

### Claim 8

A method of segmenting tomographic biomedical images, comprising:
identifying, by a computing system, a plurality of acquisition parameters derived from training of an image segmentation model and defining an acquisition of tomographic biomedical images;
receiving, by the computing system, a plurality of tomographic biomedical images of a sample of a subject using the plurality of acquisition parameters and a plurality of tissue parameters, the plurality of tissue parameters associated with the section of the subject corresponding to the plurality of tomographic biomedical images, the section having at least one region of interest;
applying, by the computing system, the image segmentation model to the plurality of tomographic biomedical images to generate a segmented tomographic biomedical image; and
storing, by the computing system, the segmented tomographic biomedical image identifying the at least one region of interest on the section of the subject.

### Claim 9 (depends on 8)

The method of claim 8, further comprising establishing, by the computing system, the image segmentation model comprising a generator to determine the plurality of acquisition parameters, an image synthesizer to generate at least one synthesized tomographic biomedical image, a discriminator to determine whether an input tomographic biomedical image is synthesized, using a training dataset comprising a sample tomographic biomedical image and an annotation identifying at least one region of interest tomographic within the sample biomedical image.

### Claim 10 (depends on 9)

The method of claim 9, wherein establishing the image segmentation model further comprises updating one or more parameters of the generator, the discriminator, and the segmentor using a loss metric, the loss metric including at least one of a segmentation loss metric or a matching loss metric.

### Claim 11 (depends on 8)

The method of claim 8, wherein applying the image segmentation model further comprises applying a segmentor of the image segmentation model to the plurality of tomographic biomedical images, without applying a generator, an image synthesizer, and a discriminator used to train the image segmentation model based on a training dataset.

### Claim 12 (depends on 8)

The method of claim 8, wherein the image segmentation model comprises a segmentor, the segmentor comprising a plurality of residual layers corresponding to a plurality of resolutions to generate the segmented tomographic biomedical image, each of the plurality of residual layers having one or more residual connection units (RCUs) to process at least one feature map for a corresponding resolution of the plurality of resolutions.

### Claim 13 (depends on 8)

The method of claim 8, further comprising providing, to a magnetic resonance imaging (MRI) device, the plurality of acquisition parameters for the acquisition the plurality of tomographic biomedical image, the plurality of acquisition parameters identifying at least one a flip angle (FA), a repetition time (TR), or an echo time (TE), the plurality of tissue parameters identifying at least one of a proton density (PD), a longitudinal relaxation time (T1), or a transverse relaxation time (T2).

### Claim 14

A system for training models to segment tomographic biomedical images, comprising:
a computing system having one or more processors coupled with memory, configured to:
identify a training dataset having: a plurality of sample tomographic biomedical images acquired from a section of a subject, a plurality of tissue parameters associated with the section of subject, and an annotation identifying at least one region on the section in at least one of the plurality of sample tomographic biomedical images;
train an image segmentation model using the training dataset, the image segmentation model comprising:
a generator to determine a plurality of acquisition parameters using the plurality of sample tomographic biomedical images, the plurality of acquisition parameters defining an acquisition of the plurality of sample tomographic biomedical images from the tissue sample;
an image synthesizer to generate a plurality of synthesized tomographic biomedical images in accordance with the plurality of tissue parameters and the plurality of acquisition parameters;
a discriminator to determine a classification result indicating whether an input biomedical image corresponding to one of the plurality of sample tomographic biomedical image or the plurality of synthesized tomographic biomedical images is synthesized; and
a segmentor to generate, using the input biomedical image, a segmented biomedical image identifying the at least one region on the section of the subject; and
store the image segmentation model for use to identify one or more regions of interest in tomographic biomedical images.

### Claim 15 (depends on 14)

The system of claim 14, wherein the computing system is further configured to train the image segmentation model by:
determining a segmentation loss metric based on the segmented tomographic biomedical image and the annotation; and
updating one or more parameters of at least one of the generator, the discriminator, and the segmentor of the image segmentation model using the segmentation loss metric.

### Claim 16 (depends on 14)

The system of claim 14, wherein the computing system is further configured to train the image segmentation model by:
determining a matching loss metric based on the plurality of sample tomographic biomedical image and the corresponding plurality of synthesized tomographic biomedical image; and
updating one or more parameters of at least one of the generator, the discriminator, and the segmentor of the image segmentation model using the matching loss metric.

### Claim 17 (depends on 14)

The system of claim 14, wherein the computing system is further configured to train the image segmentation model by updating one or more parameters of at least one of the generator and the discriminator using a loss metric associated with the segmentor.

### Claim 18 (depends on 14)

The system of claim 14, wherein the computing system is further configured to provide, responsive to training of the image segmentation model, the plurality of acquisition parameters for acquisition of the tomographic biomedical images, the plurality of acquisition parameters identifying at least one of a flip angle (FA), a repetition time (TR), or an echo time (TE).

### Claim 19 (depends on 14)

The system of claim 14, wherein the segmentor of the image segmentation model comprises a plurality of residual layers corresponding to a plurality of resolutions to generate the segmented tomographic biomedical image, each of the plurality of residual layers having one or more residual connection units (RCUs) to process at least one feature map for a corresponding resolution of the plurality of resolutions.

### Claim 20 (depends on 14)

The system of claim 14, wherein each of the plurality of sample tomographic biomedical images is acquired from the section of the subject in vivo via magnetic resonance imaging, the plurality of tissue parameters identifying at least one of proton density (PD), a longitudinal relaxation time (T1), or a transverse relaxation time (T2) for the acquisition of the plurality of sample tomographic biomedical images.
