White balance and fixed pattern noise frame calibration using distal cap
AssigneeDePuy Synthes Products, Inc.
InventorLaurent Blanquart
Life of this patent
Estimating the term…
Abstract
The disclosure extends to methods, systems, and computer program products for producing an image in light deficient environments and correction of white balance and/or fixed pattern noise at startup or at any other time during a procedure.
Claims34
A method for adjusting fixed pattern noise in a digital imaging process for use with an endoscope in ambient light deficient environments comprising:
- providing, during a training period, a cap that fits over a lumen of the endoscope such that the cap is blocking external illumination to each pixel in a pixel array, the lumen comprising an elongated lumen mechanically coupled to a handle for manipulation of the lumen during a surgical procedure;
- creating, during the training period a first dark frame reference for use in removing fixed pattern noise while the cap is in place with no applied electromagnetic radiation and at a quiescent operating temperature for the endoscope during the training period;
- removing the cap from the lumen at the quiescent operating temperature for the endoscope;
- in response to removing the cap from the lumen, sensing electromagnetic radiation with said pixel array to create an image frame;
- and
- correcting the image frame by removing fixed pattern noise from an image using the first dark frame reference.
A system for digital imaging for use in ambient light deficient environments comprising:
- an endoscope comprising a lumen and an image sensor, wherein the image sensor comprises a pixel array that senses electromagnetic radiation, the lumen comprising an elongated lumen mechanically coupled to a handle for manipulation of the lumen during a surgical procedure;
- a cap configured to selectively cover a distal end of the lumen to block external illumination to each pixel in said pixel array;
- a camera control unit in electrical communication with the image sensor;
- wherein the image sensor creates a dark frame reference, during a training period, for use in removing fixed pattern noise while the cap is in place with no applied electromagnetic radiation at a quiescent operating temperature for the endoscope during the training period, and in response to removing the cap from the lumen at the quiescent operating temperature for the endoscope during the training period, senses electromagnetic radiation with said pixel array to create an image frame;
- and
- wherein the camera control unit corrects the image frame by removing fixed pattern noise from an image using the dark frame reference.
A method for adjusting fixed pattern noise in a digital imaging process for use with an endoscope in ambient light deficient environments comprising:
- providing, during a training period, a cap that fits over a lumen of the endoscope such that the cap is blocking external illumination to each pixel in a pixel array, wherein the lumen comprises a lumen mechanically coupled to a handle for manipulation of the lumen during a surgical procedure;
- creating a dark frame reference, during a training period, for use in removing fixed pattern noise while the cap is in place with no applied electromagnetic radiation at a quiescent operating temperature for the endoscope during the training period;
- illuminating, during the training period, an interior of the cap using a controlled source of electromagnetic radiation;
- determining, during the training period white balance coefficients while the cap is in place and during illumination of the interior by a source of electromagnetic illumination at a quiescent operating temperature for the endoscope during the training period;
- removing the cap from the lumen at the quiescent operating temperature for the endoscope;
- in response to removing the cap from the lumen, sensing electromagnetic radiation with said pixel array to create an image frame;
- and
- correcting the image frame using the dark frame reference and the white balance coefficients.
A system for digital imaging for use in ambient light deficient environments comprising:
- an endoscope comprising a lumen and an image sensor, wherein the image sensor comprises a pixel array that senses electromagnetic radiation, the lumen comprising an elongated lumen mechanically coupled to a handle for manipulation of the lumen during a surgical procedure;
- a cap configured to selectively cover a distal end of the lumen to block external illumination to each pixel in said pixel array;
- a camera control unit in electrical communication with the image sensor and comprising one or more of a processor and memory to control that cause the image sensor to:
- create a dark frame reference, during a training period, for use in removing fixed pattern noise while the cap is in place with no applied electromagnetic radiation at a quiescent operating temperature for the endoscope during the training period;
- determining white balance coefficients based on a white reference frame captured while the cap is in place and during illumination of the interior of the cap by a source of electromagnetic radiation at the quiescent operating temperature for the endoscope during the training period;
- and
- in response to removing the cap from the lumen at the quiescent operating temperature for the endo scope during the training period, correct an image frame by removing fixed pattern noise from an image using the dark frame reference and correcting the image frame using the white balance coefficients.
Dependencies are inferred from the claim text.