Image processing device, method, and program
AssigneeFUJIFILM Corporation
InventorSadato Akahori
Life of this patent
Estimating the term…
Abstract
A processor acquires a three-dimensional image of a subject, acquires a real endoscopic image in a lumen structure of the subject, which is picked up by an endoscope inserted into the lumen structure of the subject, derives a virtual viewpoint in the three-dimensional image of the endoscope using the real endoscopic image and the three-dimensional image, acquires a radiation image of the subject in which the endoscope is inserted into the lumen structure, performs registration between the radiation image and the three-dimensional image, and superimposes and displays at least a part of the lumen structure included in the three-dimensional image, on the radiation image, based on the virtual viewpoint and a result of the registration.
Claims4
An image processing device comprising:
- at least one processor,
- wherein the processor is configured to:
- acquire a three-dimensional image of a subject;
- acquire a real endoscopic image in a lumen structure of the subject, which is picked up by an endoscope inserted into the lumen structure of the subject;
- derive a virtual viewpoint in the three-dimensional image of the endoscope using the real endoscopic image and the three-dimensional image;
- acquire a radiation image of the subject in which the endoscope is inserted into the lumen structure;
- detect a position of the endoscope from the radiation image;
- perform registration between the radiation image and the three-dimensional image by setting a projection condition of the three-dimensional image such that a projection position in a case in which the virtual viewpoint is projected onto the radiation image matches the position of the endoscope and such that a specific anatomical structure included in the radiation image matches the specific anatomical structure included in a projection image derived by projecting the three-dimensional image onto the radiation image, wherein the registration includes non-rigid registration;
- and
- superimpose and display at least a part of the lumen structure included in the three-dimensional image, on the radiation image, based on the virtual viewpoint and a result of the registration.
An image processing method comprising:
- acquiring a three-dimensional image of a subject;
- acquiring a real endoscopic image in a lumen structure of the subject, which is picked up by an endoscope inserted into the lumen structure of the subject;
- deriving a virtual viewpoint in the three-dimensional image of the endoscope using the real endoscopic image and the three-dimensional image;
- acquiring a radiation image of the subject in which the endoscope is inserted into the lumen structure;
- detecting a position of the endoscope from the radiation image;
- performing registration between the radiation image and the three-dimensional image by setting a projection condition of the three-dimensional image such that a projection position in a case in which the virtual viewpoint is projected onto the radiation image matches the position of the endoscope and such that a specific anatomical structure included in the radiation image matches the specific anatomical structure included in a projection image derived by projecting the three-dimensional image onto the radiation image, wherein the registration includes non-rigid registration;
- and
- superimposing and displaying at least a part of the lumen structure included in the three-dimensional image, on the radiation image, based on the virtual viewpoint and a result of the registration.
A non-transitory computer-readable storage medium that stores an image processing program causing a computer to execute a process comprising:
- acquiring a three-dimensional image of a subject;
- acquiring a real endoscopic image in a lumen structure of the subject, which is picked up by an endoscope inserted into the lumen structure of the subject;
- deriving a virtual viewpoint in the three-dimensional image of the endoscope using the real endoscopic image and the three-dimensional image;
- acquiring a radiation image of the subject in which the endoscope is inserted into the lumen structure;
- detecting a position of the endoscope from the radiation image;
- performing registration between the radiation image and the three-dimensional image by setting a projection condition of the three-dimensional image such that a projection position in a case in which the virtual viewpoint is projected onto the radiation image matches the position of the endoscope and such that a specific anatomical structure included in the radiation image matches the specific anatomical structure included in a projection image derived by projecting the three-dimensional image onto the radiation image, wherein the registration includes non-rigid registration;
- and
- superimposing and displaying at least a part of the lumen structure included in the three-dimensional image, on the radiation image, based on the virtual viewpoint and a result of the registration.
Dependencies are inferred from the claim text.