Back to results
US 2025/0359730 A1Published application
Steerable endoscope system with augmented view
AssigneeCovidien LP
InventorsPeter Douglas Colin Inglis, Derek Scot Tata
Life of this patent
Estimating the term…
Abstract
A steerable endoscope system is provided with an augmented view. An augmented reality display includes a rendered model of an anatomical structure corresponding to a patient anatomy pinned in the field of view, an endoscope marker moving through the virtual model, and an image from an endoscope at a location within the patient anatomy.
Claims20
A computer-controlled medical-scope system, comprising:
- a medical scope comprising a steerable distal tip with a camera that produces an image signal and an orientation sensor that produces an orientation signal;
- a first display comprising a hardware screen that depicts images from the image signal;
- and
- a second display comprising an augmented reality visualization, wherein the augmented reality visualization comprises a composite view of computer-generated graphics overlaid on a real-world field of view, wherein the computer-generated graphics comprise:
- an anatomical model;
- a scope marker positioned in the anatomical model according to the orientation signal;
- a first illumination depicting a real-time direction of view of the camera;
- and
- a second illumination depicting where the medical scope has previously traveled.
6 more elements
A computer-implemented method for generating an augmented reality display over a field of view, comprising:
- receiving, at a controller, a position signal from a medical scope, the position signal comprising position, orientation, or movement data of a steerable distal end of the medical scope;
- receiving, at the controller, sensor signals from one or more sensors of the medical scope, the sensor signals comprising real-time data including a two-dimensional (2D) camera image associated with a current position of the medical scope;
- rendering, at the controller, virtual objects comprising:
- a three-dimensional anatomical model registered to a real object in the field of view;
- a scope marker positioned within the anatomical model at the current position of the medical scope;
- and
- a three-dimensional image portion, based on the 2D camera image, mapped onto the three-dimensional anatomical model in front of the scope marker;
- and
- displaying the virtual objects through a head-mounted viewer.
6 more elements
A computer-controlled medical scope system, comprising:
- a medical scope comprising:
- a steerable distal tip comprising:
- a camera that produces an image signal;
- and
- an orientation sensor that produces an orientation signal;
- a medical-scope controller having a display comprising a hardware screen that depicts images from the image signal;
- and
- an augmented reality viewer that generates an augmented reality visualization comprising a composite view of computer-generated graphics overlaid on a real-world field of view, wherein the computer-generated graphics comprise:
- an anatomical model;
- a scope marker positioned in the anatomical model according to the orientation signal;
- a first illumination depicting a real-time direction of view of the camera;
- and
- a second illumination to indicate where the medical scope has previously traveled.
10 more elements
Dependencies are inferred from the claim text.