Guidance method based on 3D-2D pose estimation and 3D-CT registration with application to live bronchoscopy
AssigneeThe Penn State Research Foundation
InventorsWilliam E. Higgins, Scott A. Merritt, Lav Rai
Life of this patent
Estimating the term…
Loading patent…
AssigneeThe Penn State Research Foundation
InventorsWilliam E. Higgins, Scott A. Merritt, Lav Rai
Estimating the term…
A method provides guidance to the physician during a live bronchoscopy or other endoscopic procedures. The 3D motion of the bronchoscope is estimated using a fast coarse tracking step followed by a fine registration step. The tracking is based on finding a set of corresponding feature points across a plurality of consecutive bronchoscopic video frames, then estimating for the new pose of the bronchoscope. In the preferred embodiment the pose estimation is based on linearization of the rotation matrix. By giving a set of corresponding points across the current bronchoscopic video image, and the CT-based virtual image as an input, the same method can also be used for manual registration. The fine registration step is preferably a gradient-based Gauss-Newton method that maximizes the correlation between the bronchoscopic video image and the CT-based virtual image. The continuous guidance is provided by estimating the 3D motion of the bronchoscope in a loop. Since depth-map information is available, tracking can be done by solving a 3D-2D pose estimation problem. A 3D-2D pose estimation problem is more constrained than a 2D-2D pose estimation problem and does not suffer from the limitations associated with computing an essential matrix. The use of correlation-based cost, instead of mutual information as a registration cost, makes it simpler to use gradient-based methods for registration.
A method of providing guidance in real-time or near real-time in conjunction with an endoscopic procedure, comprising the steps of:
A method of providing guidance in conjunction with an endoscopic procedure, comprising the steps of:
A system for guiding an endoscope through a body lumen, comprising:
Dependencies are inferred from the claim text.