Depth-based generation of mixed-reality images
AssigneeIntuitive Surgical Operations, Inc.
InventorsPourya Shirazian, A. Jonathan McLeod, Hidenori Shikata
Life of this patent
Estimating the term…
Abstract
An illustrative system may be configured to determine a region of interest within an image depicting a scene that includes one or more anatomical objects, access a virtual model associated with the one or more anatomical objects, and present a combined image that includes the virtual model superimposed on the image. The combined image may be presented by directing a display device to display a first portion of the virtual model that is positioned within the region of interest of the image and abstain from displaying a second portion of the virtual model that is positioned outside the region of interest of the image.
Claims60
A computer-assisted medical system comprising:
- a repositionable manipulator arm configured to be coupled to an imaging device, the imaging device configured to capture an image depicting a scene that includes one or more anatomical objects positioned within a field of view of the imaging device;
- and
- a computing device communicatively coupled with the imaging device and configured to:
- determine a region of interest within the image;
- access a virtual model associated with the one or more anatomical objects;
- and
- present a combined image that includes the virtual model superimposed on the image by directing a display device to:
- display, within the combined image, a first portion of the virtual model that is positioned within the region of interest of the image, and
- abstain from displaying, within the combined image, a second portion of the virtual model that is positioned outside the region of interest of the image.
A system comprising:
- a memory storing instructions;
- and
- one or more processors communicatively coupled to the memory and configured to execute the instructions to perform a process comprising:
- determining a region of interest within an image depicting a scene that includes one or more anatomical objects;
- accessing a virtual model associated with the one or more anatomical objects;
- and
- presenting a combined image that includes the virtual model superimposed on the image, the presenting comprising directing a display device to:
- display, within the combined image, a first portion of the virtual model that is positioned within the region of interest of the image, and
- abstain from displaying, within the combined image, a second portion of the virtual model that is positioned outside the region of interest of the image.
A method comprising:
- determining a region of interest within an image depicting a scene that includes one or more anatomical objects;
- accessing a virtual model associated with the one or more anatomical objects;
- and
- presenting a combined image that includes the virtual model superimposed on the image, the presenting comprising directing a display device to:
- display, within the combined image, a first portion of the virtual model that is positioned within the region of interest of the image, and
- abstain from displaying, within the combined image, a second portion of the virtual model that is positioned outside the region of interest of the image.
A non-transitory computer-readable medium storing instructions that, when executed, direct a processor of a computing device to perform a process comprising:
- determining a region of interest within an image depicting a scene that includes one or more anatomical objects;
- accessing a virtual model associated with the one or more anatomical objects;
- and
- presenting a combined image that includes the virtual model superimposed on the image, the presenting comprising directing a display device to:
- display, within the combined image, a first portion of the virtual model that is positioned within the region of interest of the image, and
- abstain from displaying, within the combined image, a second portion of the virtual model that is positioned outside the region of interest of the image.
Dependencies are inferred from the claim text.