Systems and methods utilizing Raman spectroscopy for in vivo analysis

A computing system for processing image data to characterize tissue, the computing system comprising:

• at least one memory storing instructions;
• and
• at least one processor coupled to the at least one memory and configured to execute the instructions to perform one or more operations including:
• receiving, from a medical device removably coupled to the computing system, visible image data of the tissue, and Raman spectroscopy image data of the tissue;
• processing, using a trained machine-learning model, the Raman spectroscopy image data to identify a tissue characteristic of a portion of the tissue associated with a first pixel region of the Raman spectroscopy image data;
• registering the visible image data to the Raman spectroscopy image data;
• identifying a second pixel region of the visible image data corresponding to the first pixel region of the Raman spectroscopy image data based on the registering;
• generating an output view including a visual indicator overlaid on the second pixel region of the visible image data, wherein the visual indicator visually indicates the portion of the tissue exhibiting the tissue characteristic;
• and
• providing, to a display device removably coupled to the computing system, the output view for display.

An imaging system for processing image data to characterize tissue, the imaging system comprising:

• a medical device including a visible light emitter and a laser emitter configured to respectively facilitate capture, by the medical device, of visible image data of the tissue, and Raman spectroscopy image data of the tissue;
• and
• a computing system to which the medical device is removably coupled to, the computing system comprising:
• at least one memory storing instructions;
• and
• at least one processor coupled to the at least one memory and configured to execute the instructions to perform one or more operations including:
• causing the medical device to alternatingly operate the visible light emitter and the laser emitter;
• receiving, from the medical device, the visible image data of the tissue as the medical device is operating the visible light emitter;
• causing the visible image data to be displayed on a display device removably coupled to the computing system;
• receiving, from the medical device, the Raman spectroscopy image data of the tissue as the medical device is operating the laser emitter;
• applying a trained machine-learning model to the Raman spectroscopy image data to identify a tissue characteristic of a portion of the tissue included in a first image region of the Raman spectroscopy image data;
• registering the Raman spectroscopy image data and the visible image data with one another to identify a second image region of the visible image data corresponding to the first image region of the Raman spectroscopy image data;
• generating a visual indicator to represent a location of the portion of the tissue;
• and
• causing an overlay of the visual indicator on the second image region of the visible image data displayed on the display device.