# US 2021/0343031 A1 · Lesion localization in an organ

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0343031 A1
- Document ID: US20210343031A1
- Status: Published application
- Kind: A1
- Application number: 17/272,152
- Filed: 2018-08-29
- Published: 2021-11-04
- Earliest claimed: 2018-08-29
- Assignees: Agency for Science, Technology and Research; National University of Singapore
- Applicants: Agency for Science, Technology and Research; National University of Singapore
- Inventors: Yanling CHI; Weimin HUANG; Jiayin ZHOU; Kyaw Kyar TOE; Stephen CHANG; Chee Kong CHUI
- Web page: https://patentgrep.com/patent/US20210343031A1

## CPC

- G06T 7/33: using feature-based methods
- A61B 18/1492: {having a flexible, catheter-like structure, e.g. for heart ablation (A61B18/1477 takes precedence)}
- G06T 3/60: Rotation of whole images or parts thereof
- G06T 7/32: using correlation-based methods
- G06T 7/73: using feature-based methods
- A61B 2018/00994: {combining two or more different kinds of non-mechanical energy or combining one or more non-mechanical energies with ultrasound}
- A61B 2034/2063: {Acoustic tracking systems, e.g. using ultrasound}
- A61B 2034/2065: {Tracking using image or pattern recognition}
- G06T 2207/10081: Computed x-ray tomography [CT]
- G06T 2207/10132: Ultrasound image
- G06T 2207/20081: Training; Learning
- G06T 2207/30056: Liver; Hepatic
- G06T 2207/30096: Tumor; Lesion
- G06T 2207/30204: Marker
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

The invention relates to a computerized method (200) for localizing a lesion in an organ of a subject, comprises performing: a first image registration operation (400) for determining a rigid transformation matrix based on alignment of a two-dimensional ultrasound (2D-US) image representation (116) and a three-dimensional computed tomography (3D-CT) image representation (120) of the organ, the 2D-US image representation (116) acquired from a transducer probe (114); a second image registration operation (500) for refining the rigid transformation matrix based on image feature descriptors of the 2D-US and 3D-CT image representations (116, 120); and a localization operation (600) for localizing the lesion relative to the transducer probe (114) based on the refined rigid transformation matrix and a 3D-CT position of the lesion in the 3D-CT image representation (120). A system for performing the method is also disclosed herein. The system may further comprise an ablation apparatus for radio frequency ablation of the lesion.

## Claims

### Claim 1

A computerized method for localizing a lesion in an organ of a subject, the method comprising performing:
a first image registration operation for determining a rigid transformation matrix based on alignment of a two-dimensional ultrasound (2D-US) image representation and a three-dimensional computed tomography (3D-CT) image representation of the organ, the 2D-US image representation acquired from a transducer probe;
a second image registration operation for refining the rigid transformation matrix based on image feature descriptors of the 2D-US and 3D-CT image representations; and
a localization operation for localizing the lesion relative to the transducer probe based on the refined rigid transformation matrix and a 3D-CT position of the lesion in the 3D-CT image representation.

### Claim 2 (depends on 1)

The method according to claim 1, the method further comprising performing, before the first image registration operation, a calibration operation for calibrating the transducer probe.

### Claim 3 (depends on 2)

The method according to claim 2, the calibration operation comprising defining a reference coordinate frame of the transducer probe, wherein the lesion is localized in the reference coordinate frame.

### Claim 4 (depends on 1)

The method according to claim 1, the first image registration operation comprising:
receiving the 2D-US image representation acquired from the transducer probe used on the subject; and
retrieving, from an image database, the 3D-CT image representation pre-acquired from the subject.

### Claim 5 (depends on 1)

The method according to claim 1, the first image registration operation comprising:
defining three or more CT fiducial markers around the 3D-CT lesion position in the 3D-CT image representation; and
defining three or more US fiducial markers in the 2D-US image representation corresponding to the CT fiducial markers.

### Claim 6 (depends on 5)

The method according to claim 5, the first image registration operation further comprising:
defining a CT coordinate frame based on the CT fiducial markers;
defining a US coordinate frame based on the US fiducial markers; and
aligning the US and CT coordinate frames to thereby determine the rigid transformation matrix.

### Claim 7 (depends on 1)

The method according to claim 1, the first image registration operation comprising:
determining a set of rigid geometric transformations based on alignment of the 2D-US and 3D-CT image representations; and
performing said determining of the rigid transformation matrix based on the set of rigid geometric transformations.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the set of rigid geometric transformations comprises rotations and/or translations in up to six degrees of freedom.

### Claim 9 (depends on 7)

The method according to claim 7, the second image registration operation comprising iteratively determining modal similarity metrics based on the image feature descriptors of the 2D-US and 3D-CT image representations and iterative refinements to the set of rigid geometric transformations.

### Claim 10 (depends on 9)

The method according to claim 9, wherein the iterative refinements are based on one or more of the degrees of freedom.

### Claim 11 (depends on 9)

The method according to claim 9, the second image registration operation further comprising identifying a maximum multi-modal similarity metric associated with maximum correlation of the image feature descriptors, the maximum multi-modal similarity metric corresponding to a refined set of rigid geometric transformations.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the maximum correlation of the image feature descriptors is determined using a gradient descent algorithm.

### Claim 13 (depends on 11)

The method according to claim 11, the second image registration operation further comprising performing said refining of the rigid transformation matrix based on the refined set of rigid geometric transformations.

### Claim 14

A system for localizing a lesion in an organ of a subject, the system comprising:
a transducer probe for acquiring a two-dimensional ultrasound (2D-US) image representation of the organ; and
a computer device communicable with the transducer probe, the computer device comprising:
an image registration module configured for performing:
a first image registration operation for determining a rigid transformation matrix based on alignment of the 2D-US image representation and a three-dimensional computed tomography (3D-CT) image representation of the organ; and
a second image registration operation for refining the rigid transformation matrix based on image feature descriptors of the 2D-US and 3D-CT image representations; and
a localization module configured for performing a localization operation for localizing the lesion relative to the transducer probe based on the refined rigid transformation matrix and a 3D-CT position of the lesion in the 3D-CT image representation.

### Claim 15 (depends on 14)

The system according to claim 14, further comprising a calibration module configured for performing a calibration operation for calibrating the transducer probe.

### Claim 16 (depends on 14)

The system according to claim 14, further comprising a reference position sensor disposed on the transducer probe, wherein the lesion is localized relative to the reference position sensor.

### Claim 17 (depends on 16)

The system according to claim 16, further comprising an ablation apparatus for radio frequency ablation (RFA) of the lesion.

### Claim 18 (depends on 17)

The system according to claim 17, the ablation apparatus comprising a RFA probe for insertion into the lesion and a set of position sensors calibrated with the RFA probe.

### Claim 19 (depends on 18)

The system according to claim 18, wherein the reference position sensor is cooperative with the set of position sensors for ultrasonically guiding the RFA probe to the localized lesion.

### Claim 20 (depends on 14)

The system according to claim 14, wherein the image registration module is trained using training data from a set of training images for determining the image feature descriptors.
