# US 2016/0242745 A1 · Systems, Methods and Computer Readable Storage Media Storing Instructions for Image-Guided Interventions Based on Patient-Specific Models

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0242745 A1
- Document ID: US20160242745A1
- Status: Published application
- Kind: A1
- Application number: 15/050,109
- Filed: 2016-02-22
- Published: 2016-08-25
- Earliest claimed: 2015-02-20
- Assignees: Emory University
- Applicants: Emory University
- Inventors: Xiaofeng Yang; Tian Liu
- Web page: https://patentgrep.com/patent/US20160242745A1

## CPC

- A61B 8/5261: {combining images from different diagnostic modalities, e.g. ultrasound and X-ray}
- A61B 5/055: involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
- A61B 8/08: Clinical applications (A61B8/02, A61B8/04, A61B8/06 take precedence)
- A61B 8/12: in body cavities or body tracts, e.g. by using catheters
- A61B 8/4209: {by using holders, e.g. positioning frames}
- A61B 8/4245: {involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient}
- A61B 8/483: {involving the acquisition of a 3D volume of data}
- A61B 8/485: {involving measuring strain or elastic properties}
- A61B 8/5223: {for extracting a diagnostic or physiological parameter from medical diagnostic data (for algorithms to analyse biomedical images G06T7/0012)}
- G16H 50/50: for simulation or modelling of medical disorders
- A61B 6/032: {Transmission computed tomography [CT]}
- A61B 6/037: {Emission tomography}
- A61B 6/488: {involving pre-scan acquisition}
- A61B 6/5247: {combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound}
- A61B 2576/00: Medical imaging apparatus involving image processing or analysis (A61B1/00009, A61B6/52 and A61B8/52 take precedence)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

Systems, methods, and computer-readable storage media relate to generate an integrated image based on strain data and elastic model. The method may include determining, by a processor, a range of probe positions for placement of an ultrasound probe with respect to a patient based on strain data, the range of positions including a first position, a second position, and one or more positions there between. The method may also include acquiring 3D TRUS images of the patient at each of the one or more positions of the range and generating a patient specific biomechanical model based on the 3D TRUS images. The method may further include integrating the patient specific biomechanical model, the 3D TRUS images and MR images to generate an integrated image of the prostate. The methods, systems, and computer readable media can improve efficiency and accuracy of 3D TRUS and MR image registration, e.g., for image-guided interventions.

## Claims

### Claim 1

A computer-implemented method for generating an integrated image of a prostate of a patient, comprising:
determining, by a processor, a range of probe positions for placement of an ultrasound probe with respect to a patient based on strain data, the range of probe positions including a first probe position, a second probe position, and one or more probe positions between the first probe position and the second probe position;
acquiring 3D TRUS images of the patient at each of the one or more probe positions of the range;
generating a patient specific biomechanical model based on the 3D TRUS images; and
integrating the patient specific biomechanical model, the 3D TRUS images and MR images to generate an integrated image of the prostate.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the determining the range of one or more probe positions includes:
acquiring one or more 2D TRUS images at a reference probe position;
causing a stepper to move in a plurality of probe positions in a y direction relative to the reference probe position and the patient;
acquiring one or more 2D TRUS images at each of the plurality of probe positions;
generating strain data based on a comparison of the 2D TRUS images for the reference position and each of the plurality of probe positions; and
determining the range of probe positions based on the strain data.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the strain data represents a comparison of a strain value of each voxel with respect to each probe position.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the range of probe positions defines an area in which strain values are linear.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the patient specific biomechanical model is an elastic model.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the generating the patient specific biomechanical model includes:
mapping the 3D images for each of the one or more probe positions and the second probe position to the 3D images for the first probe position to generate deformation maps;
generating the strain data from the generated deformation maps; and
generating the patient specific biomechanical model based on the strain data.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the integrating the patient specific biomechanical model, the 3D TRUS images and the MR images to generate an integrated image of the prostate includes:
segmenting the 3D TRUS images and the MR images to respectively determine 3D TRUS prostate surface and MR prostate surface;
registering the 3D TRUS prostate surface and the MR prostate surface to determine B-spline based transformation; and
incorporating the patient specific biomechanical model into B-spline based transformation to generate the integrated images.

### Claim 8

A system for generating an integrated image of a prostate of a patient, comprising:
an ultrasound system including an ultrasound probe, an ultrasound stepper configured to hold and move the ultrasound probe and an image acquisition device configured to acquire 2D and 3D TRUS images; and
a processor and a memory, wherein the processor is configured to:
determine a range of probe positions for placement of the ultrasound probe with respect to a patient based on strain data, the range of probe positions including a first probe position, a second probe position, and one or more probe positions between the first probe position and the second probe position;
acquire 3D TRUS images of the patient at each of the one or more probe positions of the range;
generate a patient specific biomechanical model based on the 3D TRUS images; and
integrate the patient specific biomechanical model, the 3D TRUS images and MR images to generate an integrated image of the prostate.

### Claim 9 (depends on 8)

The system according to claim 8, wherein the determination of the range of one or more probe positions includes:
acquire one or more 2D TRUS images at a reference probe position;
cause the stepper to move in a plurality of probe positions in a y direction relative to the reference probe position and the patient;
acquire one or more 2D TRUS images at each of the plurality of probe positions;
generate the strain data based on a comparison of the 2D TRUS images for the reference position and each of the plurality of probe positions; and
determine the range of probe positions based on the strain data.

### Claim 10 (depends on 9)

The system according to claim 9, wherein the strain data represents a comparison of a strain value of each voxel with respect to each probe position.

### Claim 11 (depends on 10)

The system according to claim 10, wherein the range of probe positions defines an area in which strain values are linear.

### Claim 12 (depends on 8)

The system according to claim 8, wherein the patient specific biomechanical model is an elastic model.

### Claim 13 (depends on 8)

The system according to claim 8, wherein the generation of the patient specific biomechanical model includes:
map the 3D images for each of the one or more probe positions and the second probe position to the 3D images for the first probe position to generate deformation maps;
generate strain data from the generated deformation maps; and
generate the patient specific biomechanical model based on the strain data.

### Claim 14 (depends on 8)

The system according to claim 8, wherein the integration of the patient specific biomechanical model, the 3D TRUS images and the MR images to generate an integrated image of the prostate includes:
segment the 3D TRUS images and the MR images to respectively determine 3D TRUS prostate surface and MR prostate surface;
register the 3D TRUS prostate surface and the MR prostate surface to determine B-spline based transformation; and
incorporate the patient specific biomechanical model into B-spline based transformation to generate the integrated images.

### Claim 15

A non-transitory computer-readable medium storing instructions for generating an integrated image of a prostate of a patient, the instructions comprising:
determining a range of probe positions for placement of an ultrasound probe with respect to a patient based on strain data, the range of probe positions including a first probe position, a second probe position, and one or more probe positions between the first probe position and the second probe position;
acquiring 3D TRUS images of the patient at each of the one or more probe positions of the range;
generating a patient specific biomechanical model based on the 3D TRUS images; and
integrating the patient specific biomechanical model, the 3D TRUS images and MR-images to generate an integrated image of the prostate.

### Claim 16 (depends on 15)

The medium according to claim 15, wherein the determining the range of one or more positions includes:
acquiring one or more 2D TRUS images at a reference probe position;
causing a stepper to move in a plurality of probe positions in a y direction relative to the reference probe position and the patient;
acquiring one or more 2D TRUS images at each of the plurality of probe positions;
generating the strain data based on a comparison of the 2D TRUS images for the reference probe position and each of the plurality of probe positions; and
determining the range of probe positions based on the strain data.

### Claim 17 (depends on 16)

The medium according to claim 16, wherein the strain data represents a comparison of a strain value of each voxel with respect to each probe position.

### Claim 18 (depends on 17)

The medium according to claim 17, wherein the range of probe positions defines an area in which strain values are linear.

### Claim 19 (depends on 15)

The medium according to claim 15, wherein the patient specific biomechanical model is an elastic model.

### Claim 20 (depends on 15)

The medium according to claim 15, the instructions further comprising:
displaying the integrated image.
