Camera calibration using fiducial markers on surgical tools
AssigneeAsensus Surgical Europe S.à.R.L.
InventorsTal Nir, Lior Alpert
Life of this patent
Estimating the term…
Abstract
Calibration of parameters of an endoscopic or laparoscopic camera is conducted while the camera is in use capturing images of a surgical procedure at a surgical site. The surgical procedure is performed using a surgical instrument marked with a fiducial pattern. A processor receives image data from images captured by the camera and uses machine vision to detect points of the pattern, and carries out an optimization to determine the 3D pose of the surgical instrument relative to the camera and the camera parameters.
Claims22
A surgical instrument having a distal portion positionable in a body cavity, the surgical instrument including an elongate shaft and a fiducial calibration pattern for use in estimating intrinsic camera parameters of a stereo endoscopic camera used at the surgical site, the fiducial calibration pattern positioned on the elongate shaft such that the fiducial calibration pattern is disposed within the body cavity and visible to a stereo endoscopic camera capturing images from within said body cavity during a surgical procedure.
A method of calibrating a camera during surgery, comprising the steps of:
- positioning a camera with its distal end at a surgical treatment site within a body cavity;
- providing a surgical instrument having a fiducial calibration pattern thereon, and positioning the surgical instrument such that the fiducial calibration pattern is disposed within the body cavity;
- with the distal end of the camera within the body cavity, using the camera to capture a plurality of images of the surgical instrument within the body cavity;
- and
- based on locations of image fiducials in the plurality of images, and the known fiducials geometry, estimating the camera parameters.
A surgical system comprising:
- a stereo endoscopic camera positionable in a body cavity;
- a surgical instrument positionable in the body cavity, the surgical instrument including an elongate shaft and a fiducial calibration pattern on the elongate shaft;
- at least one processor comprising at least one memory storing algorithms executable by the processor to:
- while the stereo endoscopic camera is positioned with its distal tip in the body cavity, receive images from the stereo endoscopic camera, the images comprising images captured from within the body cavity, wherein said images are of the fiducial calibration pattern within the body cavity, and
- using a location of scene points in the fiducial calibration pattern in a plurality of the images and a known geometry of the fiducial calibration pattern, estimating the parameters of the stereo endoscopic camera.
Dependencies are inferred from the claim text.