Method and apparatus for quantitative and depth resolved hyperspectral fluorescence and reflectance imaging for surgical guidance

A system for surgical guidance of surgeons operating on an organ comprising:

• a stereo camera configured to prepare intraoperative stereo images of the organ in a surgical field;
• a processor adapted to extract a 3D surface model from the intraoperative stereo images;
• fluorescence imaging apparatus configured to prepare fluorescence images of the organ;
• the processor further configured to:
• input preoperative scans selected from MRI and CAT scans,
• to build a preoperative model of the organ,
• input or identify an initial tumor location of a tumor in the organ,
• input or identify initial key structure locations in the preoperative model of the organ,
• extract initial tissue surface features from marked preoperative model of the organ generate a 3-D map of fluorophore concentrations in tissue;
• determine a 3-D warp field that maps initial surface features into surface features of the intraoperative 3-D surface model of the organ,
• execute a mechanical model of the organ to determine shift of the initial tumor location to an intraoperative tumor location in the organ, and
• determine shift of the key structures from the initial locations to intraoperative structure locations;
• and
• a display device;
• where the processor is configured to display the intraoperative tumor location in the organ with intraoperative key structure locations and the 3-D map of fluorophore concentrations in tissue.