US 10,951,869 B1Granted

System for optimizing blended video streams

AssigneeKARL STORZ Imaging, Inc.

InventorEfrain Morales

Life of this patent

Estimating the term…

Loading patent…

Abstract

An enhanced fluorescence imaging system includes a light source for emitting non-visible and visible light and an image sensor for capturing non-visible and visible light image data. Data processing hardware performs operations that include determining a non-visible value associated with an amount of non-visible light captured by the image sensor and applying a color map to each non-visible value to generate non-visible light selected color values. The operations also include weighting a visible light chroma value with a non-visible chroma value to generate weighted chroma values and combining luma values of each pixel of the visible light image data to the weighted chroma values. The operations also include generating RGB values based on the luma values of the visible light image data and the weighted chroma values and transmitting the RGB values to the display.

Claims16

Dependent claims

A fluorescence imaging system comprising a light source configured to emit non-visible light and visible light and an image sensor including a plurality of pixels configured to capture non-visible light image data and visible light image data, the fluorescence imaging system configured to generate a video image onto a display, the fluorescence imaging system comprising:

data processing hardware in communication with the image sensor;
and
memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
determining, for each pixel of the plurality of pixels, a non-visible light value, the non-visible light value associated with an amount of non-visible light captured by the image sensor;
applying a color map to each non-visible light value to associate the non-visible light value with a select color to generate non-visible light selected color values;
converting, for each pixel, the associated visible light image data into a visible light luma value, a visible light blue-difference chroma value, and a visible light red-difference chroma value;
converting the non-visible light selected color values into a non-visible light luma value, a non-visible light blue-difference chroma value, and a non-visible light red-difference chroma value;
weighting the visible light blue-difference chroma value and the non-visible light blue-difference chroma value based on a weighting factor to generate a weighted blue-difference chroma value;
weighting the visible light red-difference chroma value and the non-visible light red-difference chroma value based on the weighting factor to generate a weighted red-difference chroma value;
and
combining luma values of each pixel of the visible light image data to the weighted blue-difference and red-difference chroma values so as to enhance the video image.

8 more elements

A fluorescence imaging system including a light source configured to emit non-visible light and visible light and an image sensor comprising a plurality of pixels configured to capture non-visible light image data and visible light image data, the fluorescence imaging system configured to generate a video image onto a display, the fluorescence imaging system comprising:

data processing hardware in communication with the image sensor;
and
memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
determining, for each pixel of the plurality of pixels, a non-visible light value, the non-visible light value associated with an amount of non-visible light captured by the image sensor;
adding the non-visible light value of each pixel to a select color of the visible light image data to generate added color light values;
applying a color map to each non-visible light value to associate the non-visible light value with a select color to generate a non-visible light selected color value;
weighting a visible light chroma value of the visible light image data with a non-visible light chroma value of the non-visible light selected color values to generate weighted chroma values;
combining luma values of the visible light image data to the weighted chroma values to generate combined luma-chroma light values;
converting the combined luma-chroma light values into replaced color light values;
and
weighting the added color light values with replaced color light values to generate weighted color light values so as to enhance the video image.

8 more elements

Dependencies are inferred from the claim text.