Image rotation in an endoscopic hyperspectral, fluorescence, and laser mapping imaging system
AssigneeCilag GmbH International
InventorsJoshua D. Talbert, Donald M. Wichern
Life of this patent
Estimating the term…
Abstract
Image rotation in an endoscopic hyperspectral, fluorescence, and/or laser mapping imaging system is described. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation. The system includes a rotation sensor for detecting an angle of rotation of a lumen relative to a handpiece of an endoscope. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of a hyperspectral emission, a fluorescence emission, and/or a laser mapping pattern.
Claims20
A system comprising:
- an endoscope;
- a handpiece unit;
- an emitter for emitting a plurality of pulses of electromagnetic radiation, wherein the emitter comprises a plurality of electromagnetic sources comprising:
- a hyperspectral source of electromagnetic radiation for pulsing electromagnetic radiation within a waveband comprising one or more wavelengths selected to elicit a spectral response from a tissue, and one or more of a fluorescence source for pulsing a fluorescence excitation wavelength of electromagnetic radiation, a mapping source for pulsing electromagnetic radiation to generate mapping data, or a visible source of electromagnetic radiation;
- an image sensor comprising a pixel array for sensing electromagnetic radiation;
- a controller in electronic communication with the emitter and the image sensor that is configured to synchronize operation of the emitter and the image sensor;
- and
- one or more processors for executing an image signal processing pipeline comprising instructions for generating output image frames, wherein the instructions comprise:
- receiving an angle of rotation for rotating at least one frame of a plurality of frames to maintain a constant image horizon;
- identifying integer coordinates for pixel data in the at least one frame of the plurality of frames;
- and
- applying a rotation kernel to the integer coordinates to transform the integer coordinates to real-number pixel coordinates.
A system comprising:
- an endoscope;
- a handpiece unit;
- an emitter for emitting a plurality of pulses of electromagnetic radiation, wherein the emitter comprises a plurality of electromagnetic sources comprising:
- a hyperspectral source of electromagnetic radiation for pulsing electromagnetic radiation within a waveband comprising one or more wavelengths selected to elicit a spectral response from a tissue, and one or more of a fluorescence source for pulsing a fluorescence excitation wavelength of electromagnetic radiation, a mapping source for pulsing electromagnetic radiation to generate mapping data, or a visible source of electromagnetic radiation;
- an image sensor comprising a pixel array for sensing electromagnetic radiation;
- a controller in electronic communication with the emitter and the image sensor that is configured to synchronize operation of the emitter and the image sensor;
- and
- an image signal processing pipeline for performing rotation transformations on exposure frames captured by the image sensor based on an angle of rotation of a lumen of the endoscope relative to the handpiece of the endoscope;
- wherein the image signal processing pipeline rotates one or more of the plurality of exposure frames counter to the angle of rotation to maintain a consistent image horizon of a scene being imaged by the one or more image sensors.
Dependencies are inferred from the claim text.