Constructing or reconstructing 3D structure(s)

A method for controlling, viewing and/or updating one or more imaging modalities in a display, the method comprising:

• obtaining an angiography image of an object;
• obtaining an intravascular image at an acquisition location that is within at least a portion of the object, wherein the angiography image is obtained before the obtaining of the intravascular image, after the obtaining of the intravascular image, or simultaneously with the obtaining of the intravascular image;
• displaying an image for each of multiple imaging modalities on a display, the multiple imaging modalities including at least an imaging modality for the intravascular image and an imaging modality for the angiography image;
• determining the acquisition location of the intravascular image in the object within the angiography image;
• determining an in-plane orientation of the intravascular image based on the intravascular image and the angiography image and based on a curvature by selecting one of a manual in-plane orientation determining and an automatic in-plane orientation determining, the in-plane orientation being a rotational orientation of the intravascular image in a plane that is vertical to a co-registration path and/or a longitudinal direction of the object, wherein the manual and/or automatic determining of the in-plane orientation uses:
• (i) information of the curvature and information of one or more side branches of the object, or (ii) information of the curvature, information of one or more side branches of the object, and a target of or in the object and a location of the target for a boundary condition;
• in a case where the manual in-plane orientation determining is selected, using the manual in-plane orientation determining by receiving a manually input rotation angle number and/or selecting an input rotation angle that is used to place an intravascular frame on the co-registration path or a co-registration path plane, and using or receiving a manually input frame number to change the display to show an intravascular frame corresponding to the manually input frame number for performance of the in-plane orientation determining, and/or, in a case where the automatic in-plane orientation determining is selected, using the automatic in-plane orientation determining by performing the in-plane orientation determining automatically based on the intravascular image and the angiography image and based on the curvature;
• registering the intravascular image to the angiography image based on the determined acquisition location and the determined in-plane orientation;
• and
• changing or updating the display for each of the multiple imaging modalities based on the in-plane orientation information and/or based on a request to update or change the in-plane orientation.

A non-transitory computer-readable storage medium storing at least one program for causing a computer to execute a method for controlling, viewing and/or updating one or more imaging modalities in a display, the method comprising:

• obtaining an angiography image of an object;
• obtaining an intravascular image at an acquisition location that is within at least a portion of the object, wherein the angiography image is obtained before the obtaining of the intravascular image, after the obtaining of the intravascular image, or simultaneously with the obtaining of the intravascular image;
• displaying an image for each of multiple imaging modalities on a display, the multiple imaging modalities including at least an imaging modality for the intravascular image and an imaging modality for the angiography image;
• determining the acquisition location of the intravascular image in the object within the angiography image;
• determining an in-plane orientation of the intravascular image based on the intravascular image and the angiography image and based on a curvature by selecting one of a manual in-plane orientation determining and an automatic in-plane orientation determining, the in-plane orientation being a rotational orientation of the intravascular image in a plane that is vertical to a co-registration path and/or a longitudinal direction of the object, wherein the manual and/or automatic determining of the in-plane orientation uses:
• (i) information of the curvature and information of one or more side branches of the object, or (ii) information of the curvature, information of one or more side branches of the object, and a target of or in the object and a location of the target for a boundary condition;
• in a case where the manual in-plane orientation determining is selected, using the manual in-plane orientation determining by receiving a manually input rotation angle number and/or selecting an input rotation angle that is used to place an intravascular frame on the co-registration path or a co-registration path plane, and using or receiving a manually input frame number to change the display to show an intravascular frame corresponding to the manually input frame number for performance of the in-plane orientation determining, and/or, in a case where the automatic in-plane orientation determining is selected, using the automatic in-plane orientation determining by performing the in-plane orientation determining automatically based on the intravascular image and the angiography image and based on the curvature;
• registering the intravascular image to the angiography image based on the determined acquisition location and the determined in-plane orientation;
• and
• changing or updating the display for each of the multiple imaging modalities based on the in-plane orientation information and/or based on a request to update or change the in-plane orientation.