Ultrasound imaging apparatus for registering ultrasound image with image from another modality and method of operating ultrasound imaging apparatus
AssigneeSamsung Medison Co., Ltd.
InventorsJunsung Park, Yuri Son, Yeongseon Kim, Jonghyon Yi, Yeonmo Jeong
Life of this patent
Estimating the term…
Abstract
Provided are an ultrasound imaging apparatus and an operation method for registering an ultrasound image and an image from another modality. The ultrasound imaging apparatus may register the ultrasound image and the image from the other modality based on a three-dimensional positional relationship between at least one external electromagnetic sensor attached to a patient's body and an ultrasound probe and on a position of a feature point extracted from the image from the other modality.
Claims21
A method, performed by an ultrasound imaging apparatus, of registering a first image that is an ultrasound image and a second image that is an image from another modality, the method comprising:
- loading the second image pre-acquired for a patient;
- acquiring information about a position and an orientation of an ultrasound probe based on a three-dimensional positional relationship between at least one external electromagnetic sensor attached to a first feature point of a patient's body and an electromagnetic sensor of the ultrasound probe;
- extracting, from the second image, a second feature point corresponding to the first feature point;
- registering the first and second images based on the three-dimensional positional relationship between the at least one external electromagnetic sensor and the electromagnetic sensor of the ultrasound probe and on a position of the second feature point extracted from the second image;
- and
- displaying the first image in a first region of a display and the second image registered with the first image in a second region of the display,
- wherein the registering the first and second images comprises:
- acquiring information about an angle between a first external electromagnetic sensor attached to the first feature point of the patient's body and a second external electromagnetic sensor attached to a structural feature point of the patient's body different from the first feature point;
- and
- correcting an angular error in the second image based on the information about the angle between the first external electromagnetic sensor and the second external electromagnetic sensor.
An ultrasound imaging apparatus for registering a first image that is an ultrasound image and a second image that is an image from another modality, the ultrasound imaging apparatus comprising:
- an ultrasound probe including an electromagnetic sensor;
- a storage storing the second image pre-acquired for a patient, and the storage is a non-transitory computer-readable storage medium;
- a memory storing at least one instruction for controlling an operation of the ultrasound imaging apparatus, and the memory is a non-transitory computer-readable storage medium;
- a display;
- and
- a processor configured to execute the at least one instruction stored in the memory to:
- load the second image from the storage;
- acquire information about a position and an orientation of the ultrasound probe based on a three-dimensional positional relationship between at least one external electromagnetic sensor attached to a first feature point of a patient's body and the electromagnetic sensor of the ultrasound probe;
- extract, from the second image, a second feature point corresponding to the first feature point;
- register the first and second images based on the three-dimensional positional relationship between the at least one external electromagnetic sensor and the electromagnetic sensor of the ultrasound probe and on a position of the second feature point extracted from the second image;
- and
- display the first image in a first region of the display and the second image registered with the first image in a second region of the display,
- wherein the processor further configured to execute the at least one instruction to:
- acquire information about an angle between a first external electromagnetic sensor attached to the first feature point of the patient's body and a second external electromagnetic sensor attached to a structural feature point of the patient's body different from the first feature point;
- and
- correct an angular error in the second image based on the information about the angle between the first external electromagnetic sensor and the second external electromagnetic sensor.
A computer program product comprising a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium comprises instructions to:
- load a second image pre-acquired for a patient;
- acquire information about a position and an orientation of an ultrasound probe based on a three-dimensional positional relationship between at least one external electromagnetic sensor attached to a first feature point of a patient's body and an electromagnetic sensor of the ultrasound probe;
- extract, from the second image, a second feature point corresponding to the first feature point;
- register the first and second images based on the three-dimensional positional relationship between the at least one external electromagnetic sensor and the electromagnetic sensor of the ultrasound probe and on a position of the second feature point extracted from the second image;
- and
- display the first image in a first region of a display and the second image registered with the first image in a second region of the display,
- wherein the non-transitory computer-readable storage medium further comprises instructions to:
- acquire information about an angle between a first external electromagnetic sensor attached to the first feature point of the patient's body and a second external electromagnetic sensor attached to a structural feature point of the patient's body different from the first feature point;
- and
- correct an angular error in the second image based on the information about the angle between the first external electromagnetic sensor and the second external electromagnetic sensor.
Dependencies are inferred from the claim text.