# US 2023/0267656 A1 · Machine-learning techniques for constructing medical images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0267656 A1
- Document ID: US20230267656A1
- Status: Published application
- Kind: A1
- Application number: 17/933,813
- Filed: 2022-09-20
- Published: 2023-08-24
- Earliest claimed: 2022-02-24
- Assignees: NVIDIA Corporation
- Applicants: Nvidia Corporation
- Inventors: Benjamin ECKART; Jan KAUTZ; Chao LIU; Benjamin WU
- Web page: https://patentgrep.com/patent/US20230267656A1

## CPC

- G06T 12/00: Tomographic reconstruction from projections
- G06N 3/045: Combinations of networks
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06T 5/10: using non-spatial domain filtering
- G06T 7/0012: {Biomedical image inspection}
- G06T 12/20: Inverse problem, i.e. transformations from projection space into object space
- G06T 2207/20056: Discrete and fast Fourier transform, [DFT, FFT]
- G06T 2207/20081: Training; Learning
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

In various embodiments, an inference application constructs medical images. The inference application executes a first trained machine learning model on a set of data points associated with a both a medical item and a spectral domain to generate a second model that represents the medical item within the spectral domain. The inference application maps a set of positions to a set of predicted values associated with both the medical item and the spectral domain via the second model. The inference application constructs an image of the medical item based on the first set of predicted values.

## Claims

### Claim 1

A computer-implemented method for constructing medical images, the method comprising:
executing a first trained machine learning model on a first set of data points associated with a both a first medical item and a spectral domain to generate a second model that represents the first medical item within the spectral domain;
mapping a first set of positions to a first set of predicted values associated with both the first medical item and the spectral domain via the second model; and
constructing a first image of the first medical item based on the first set of predicted values.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein executing the first trained machine learning model on the first set of data points comprises modifying a plurality of parameter values associated with a second trained machine learning model based on the first set of data points to generate the second model.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein mapping the first set of positions to the first set of predicted values comprises computing a first set of encodings based on the first set of positions.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising computing the first set of predicted values based on a plurality of parameter values that are derived from the first set of data points and associated with the second model, a plurality of learned parameter values that are associated with the second model, and the first set of positions.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein constructing the first image comprises computing an inverse Fourier transform based on the first set of positions and the first set of predicted values to generate a set of pixel values associated with the first medical item.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising generating a third model that represents a second medical item within the spectral domain based on a second set of data points associated with both the second medical item and the spectral domain.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the first medical item comprises at least one of an internal body organ, a portion of body tissue, a blood vessel, a muscle, or a bone.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the first set of data points comprises a set of magnetic resonance imaging measurements or a sequence of projections associated with a computed tomography scan.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, further comprising performing one or more machine learning operations on an untrained machine learning model based on a plurality of ground-truth values that are associated with both a training medical item and the spectral domain to generate the first trained machine learning model.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, further comprising modifying one or more learnable parameter values associated with an untrained machine learning model based on a reconstruction error associated with both a training medical item and the spectral domain to generate the first trained machine learning model.

### Claim 11

One or more non-transitory computer readable media including instructions that, when executed by one or more processors, cause the one or more processors to construct medical images by performing the steps of:
executing a first trained machine learning model on a first set of data points associated with a both a first medical item and a spectral domain to generate a second model that represents the first medical item within the spectral domain;
mapping a first set of positions to a first set of predicted values associated with both the first medical item and the spectral domain via the second model; and
constructing a first image of the first medical item based on the first set of predicted values.

### Claim 12 (depends on 11)

The one or more non-transitory computer readable media of claim 11, wherein executing the first trained machine learning model on the first set of data points comprises computing at least one of a shifting coefficient or a scaling coefficient associated with the second model.

### Claim 13 (depends on 11)

The one or more non-transitory computer readable media of claim 11, wherein mapping the first set of positions to the first set of predicted values comprises computing a first set of encodings based on the first set of positions.

### Claim 14 (depends on 11)

The one or more non-transitory computer readable media of claim 11, further comprising computing the first set of predicted values based on a plurality of parameter values that are derived from the first set of data points and associated with the second model, a plurality of learned parameter values that are associated with the second model, and the first set of positions.

### Claim 15 (depends on 11)

The one or more non-transitory computer readable media of claim 11, wherein constructing the first image comprises computing an inverse Fourier transform based on the first set of positions and the first set of predicted values to generate a set of pixel values associated with the first medical item.

### Claim 16 (depends on 11)

The one or more non-transitory computer readable media of claim 11, further comprising generating a third model that represents a second medical item within the spectral domain based on a second set of data points associated with both the second medical item and the spectral domain.

### Claim 17 (depends on 16)

The one or more non-transitory computer readable media of claim 16, wherein a first plurality of learned parameter values associated with the second model is equal to a second plurality of learned parameter values associated with the third model.

### Claim 18 (depends on 11)

The one or more non-transitory computer readable media of claim 11, wherein the first set of data points comprises a set of magnetic resonance imaging measurements, and the spectral domain comprises a k-space.

### Claim 19 (depends on 11)

The one or more non-transitory computer readable media of claim 11, further comprising performing one or more machine learning operations on an untrained machine learning model based on a plurality of sets of ground-truth values and a plurality of sets of input values to generate the first trained machine learning model, wherein the plurality of sets of ground-truth values and the plurality of sets of input values are associated with the spectral domain and a plurality of medical images.

### Claim 20

A system comprising:
one or more memories storing instructions; and
one or more processors coupled to the one or more memories that, when
executing the instructions, perform the steps of:
executing a first trained machine learning model on a first set of data points associated with a both a first medical item and a spectral domain to generate a second model that represents the first medical item within the spectral domain;
mapping a first set of positions to a first set of predicted values associated with both the first medical item and the spectral domain via the second model; and
constructing a first image of the first medical item based on the first set of predicted values.
