# US 2018/0025515 A1 · Multi-energy (spectral) image data processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025515 A1
- Document ID: US20180025515A1
- Status: Published application
- Kind: A1
- Application number: 15/551,701
- Filed: 2016-02-24
- Published: 2018-01-25
- Earliest claimed: 2015-03-09
- Assignees: Koninklijke Philips N.V.
- Applicants: Koninklijke Philips N.V
- Inventors: Gilad SHECHTER
- Web page: https://patentgrep.com/patent/US20180025515A1

## CPC

- G06T 12/30: Image post-processing, e.g. metal artefact correction
- G06T 12/20: Inverse problem, i.e. transformations from projection space into object space
- G06T 2211/408: Dual energy
- G06T 2211/421: Filtered back projection [FBP]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method includes generating a material landmark images in a low and high energy image domain. The material landmark image estimates a change of a value of an image pixel caused by adding a small amount of a known material to the pixel. The method further includes generating an air values image in the low and high energy image domain. The air values image estimates a value for each image pixel where a value of a pixel is replaced by a value representing air. The method further includes extracting from de-noised low and high images generated from the low and high line integrals, a material composition of each image pixel based on the material landmark images and air values image. The method further includes generating a signal indicative the extracted material composition.

## Claims

### Claim 1

A method, comprising:
generating a material landmark image in a low and high energy image domain, wherein the material landmark image estimates a change of a value of an image pixel caused by adding a small amount of a known material to the pixel;
generating an air values image in the low and high energy image domain, wherein the air values image estimates a value for each image pixel where a value of a pixel is replaced by a value representing air; and
extracting from de-noised low and high images generated from low and high line integrals, a material composition of each image pixel based on the material landmark images and air values image, and generating a signal indicative the extracted material composition.

### Claim 2 (depends on 1)

The method of claim 1, wherein the de-noised low and high volumetric images include beam hardening distortions, and the material composition is free of the beam hardening distortions.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving projection data, which are generated by a detector array of an imaging system in response to scanning an object with the imaging system;
processing the projection data, which produces low and high energy line integrals;
de-noising the low and high energy line integrals, which produces de-noised low and high energy line integrals; and
processing the de-noised low and high energy line integrals to correct for image beam hardening distortions.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
smoothing the low and high energy line integrals, which produces smoothed low and high energy line integrals; and
decomposing the smoothed low and high energy line integrals into 3D smoothed photoelectric effect and Compton scatter sinograms.

### Claim 5 (depends on 4)

The method of claim 4, wherein the photoelectric effect and Compton scatter equivalent paths are free of noise induced bias and negatively correlated noise.

### Claim 6 (depends on 4)

The method of claim 4, wherein generating the landmark volumetric images comprises:
generating, from the 3D smoothed photoelectric effect and Compton scatter sinograms, 3D smoothed low and high energy sinograms and 3D smoothed material low and high energy sinograms;
beam hardening correcting the 3D smoothed low and high energy sinograms and the 3D smoothed material low and high energy sinograms, producing 3D low and high sinograms and 3D material low and high sinograms;
determining a difference between the 3D low and high sinograms and 3D material low and high sinograms;
scaling the difference; and
back-projecting the scaled difference, which produces the landmark volumetric image.

### Claim 7 (depends on 4)

The method of claim 4, wherein generating the landmark volumetric images comprises: a direct calculation of the scaled 3D material low and high sinograms of differences as the derivative of the 3D material low and high sinograms with respect to an additional intersection path through the material.

### Claim 8 (depends on 6)

The method of claim 6, wherein generating the air values images comprises:
filter-back-projecting the smoothed 3D low and high sinograms, producing smoothed low and high energy volumetric images;
back-projecting the 3D smoothed photoelectric effect and Compton scatter sinograms, producing 3D smoothed photo and scatter volumetric images;
generating volumetric landmark images for base-elements used for decomposition; and
generating the air volumetric image based on the smoothed low and high energy volumetric images, the base-element volumetric landmark images, and the 3D smoothed photo and scatter volumetric images.

### Claim 9 (depends on 3)

The method of claim 3, further comprising:
reconstructing the set of low and high energy line integrals, which produces a set of low and high volumetric images; and
de-noising the set of low and high volumetric images, which produces the de-noised low and high volumetric images.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
constructing a 2D HU/HU scatter plot with the de-noised low and high energy volumetric images and the landmark and air values volumetric images; and
determining the material composition based on the 2D HU/HU scatter plot.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
receiving 2D smoothed photo and scatter image slices;
forward projecting the 2D smoothed photo and scatter image slices, producing 2D smoothed photo and scatter sinograms;
generating 2D smoothed low and high sinograms based on the 2D smoothed photo and scatter sinograms;
back-projecting the 2D smoothed low and high sinograms, producing 2D smoothed low and high image slices;
generating 2D material low and high sinograms based on the 2D smoothed photo and scatter sinograms;
generating 2D base-element low and high sinograms based on the 2D smoothed photo and scatter sinograms;
determining a difference between the 2D smoothed low and high sinograms and the 2D material and base-element low and high sinograms;
scaling the difference;
back-projecting the difference, producing landmark 2D image slices; and
generating 2D air values images based on the 2D base-element images, the 2D smoothed low and high images and the smoothed 2D photo and scatter images.

### Claim 12 (depends on 1)

The method of claim 1, further comprising:
generating one or more of a virtual monochromatic image, an iodine map, a virtual no contrast images, or an iodine to calcium classification based on the signal.

### Claim 13

A system comprising:
a landmark processor configured to generate material landmarks and air values from a set of low and high energy line integrals, wherein a material landmark estimates a change of a value of an image pixel that corresponds to adding a small amount of a known material to the pixel, and an air value estimates a values for the image pixel for a hypothetical case in which a content of the pixel is replaced by a value representing air; and
a material classification and quantification processor configured to determine from de-noised low and high volumetric images generated with the set of low and high line integrals, a material composition of each image pixel based on the material landmarks and estimated air values, and generate a signal indicative the extracted material composition.

### Claim 14 (depends on 13)

The system of claim 13, further comprising:
a projection domain processor configured to compose projection data and produce composed low and high energy line integrals;
a projection domain de-noising processor configured to de-noise the composed low and high energy line integrals and produce den-noised composed low and high energy line integrals; and
a beam hardening correction processor configured to process the de-noised composed low and high energy line integrals to correct for beam hardening distortions and produce the set of low and high energy line integrals.

### Claim 15 (depends on 13)

The system of claim 13, further comprising:
a smoothing processor configured to smooth the set of low and high energy line integrals, which produces smoothed low and high energy line integrals; and
a PE/CS decomposition processor configured to decompose the smoothed low and high energy line integrals into 3D smoothed photoelectric effect and Compton scatter sinograms.

### Claim 16 (depends on 15)

The system of claim 15, wherein the landmarks processor comprises:
a sinogram generator configured to process the 3D smoothed photoelectric effect and Compton scatter sinograms and generate 3D smoothed low and high energy sinograms and 3D smoothed material and base-element low and high energy sinograms;
a beam hardening corrector configured to process the beam hardening correcting the 3D smoothed low and high energy sinograms and the 3D smoothed material and base-element low and high energy sinograms and produce 3D smoothed low and high sinograms and 3D smoothed material low and high sinograms;
a subtractor configured to determine a difference between the 3D smoothed low and high sinograms and 3D smoothed material and base-element low and high sinograms;
a scaler configured to scale the difference; and
a back-projector configured to back-project the scaled difference and produce the landmark volumetric images.

### Claim 17 (depends on 16)

The system of claim 16, wherein the scaler scales the difference by multiplying the difference by 1000/(0.0192/mm·δ), where δ represents an additional intersection path through the landmark material or base element.

### Claim 18 (depends on 16)

The system of claim 16, wherein the landmarks processor further comprises:
a filter and 3D back-projector configured to filter and back-project the 3D smoothed low and high sinograms, producing smoothed low and high energy volumetric images, and the 3D smoothed photoelectric effect and Compton scatter sinograms, producing 3D smoothed photo and scatter volumetric images;
an adder that adds the 3D smoothed photoelectric effect and Compton scatter sinograms and landmark photo scatter low and high energy images; and
a subtractor that subtracts the output of the adder from the smoothed low and high energy volumetric images, producing the air volumetric images.

### Claim 19 (depends on 13)

The system of claim 13, further comprising:
a reconstruction processor configured to reconstruct the set of low and high energy line integrals, which produces low and high volumetric images; and
a de-noising processor configured to de-noise the low and high energy images, which produces the de-noised low and high volumetric images.

### Claim 20 (depends on 19)

The system of claim 19, wherein the material classification and quantification processor constructs a 2D HU/HU scatter plot with the landmark and air values volumetric images and the de-noised low and high energy volumetric images and determines the material composition based on the 2D HU/HU scatter plot.

### Claim 21

A non-transitory computer readable storage medium encoded with computer readable instructions, which, when executed by a processor of a computing system, causes the processor to:
receive projection data from a scan;
process the projection data into low and high spectrum images containing beam hardening image distortions;
process the low and high spectrum projection data to determine a set of landmarks; and
generate one or more of virtual monochromatic images, iodine maps, of virtual no contrast images free of beam hardening image distortions by processing the images reconstructed from the projection data based on the set of landmarks.
