Systems and methods for real time, quantitative, hyperspectral and optical property imaging for in vivo intraoperative multiplex molecular guided surgery

A system comprising:

• a processor;
• and
• a tangible, non-transitory memory configured to communicate with the processor, the tangible, non-transitory memory having instructions stored thereon that, in response to execution by the processor, cause the processor to perform operations comprising:
• causing a tissue sample to be illuminated with light across both a visible wavelength range and a near-infrared wavelength range, wherein the tissue sample has been administered with at least one fluorescent agent;
• obtaining, from a hyperspectral imaging plenoptic camera sensor, a snapshot image of the tissue sample, wherein pixels of the snapshot image capture different 2D views of the tissue sample at a same time along with multiple wavelengths of light incident on a respective sensor pixel;
• creating a hyperspectral image cube of the tissue sample from the snapshot image;
• performing spectrally-resolved quantitative fluorescence measurements on the hyperspectral image cube;
• analyzing the spectrally-resolved quantitative fluorescence measurements to detect a presence of at least one fluorescent agent in the tissue sample;
• and
• identifying an optical fingerprint of an abnormal region of the tissue sample based on the detected at least one fluorescent agent in the tissue sample.

A non-transitory computer-readable medium having instructions stored therein, wherein the instructions, when executed by a processor, cause the processor to:

• cause a tissue sample to be illuminated with light across both a visible wavelength range and a near-infrared wavelength range, wherein the tissue sample has been administered with at least one fluorescent agent;
• obtain, from a hyperspectral imaging plenoptic camera sensor, a snapshot image of the tissue sample, wherein pixels of the snapshot image capture different 2D views of the tissue sample at a same time along with multiple wavelengths of light incident on a respective sensor pixel;
• create a hyperspectral image cube of the tissue sample from the snapshot image;
• perform spectrally-resolved quantitative fluorescence measurements on the hyperspectral image cube;
• analyze the spectrally-resolved quantitative fluorescence measurements to detect a presence of at least one fluorescent agent in the tissue sample;
• and
• identify an optical fingerprint of an abnormal region of the tissue sample based on the detected at least one fluorescent agent in the tissue sample.