Back to results
US 11,600,053 B1Granted
System and method for location determination using a mixed reality device and multiple imaging cameras
AssigneesRussell Todd Nevins, David Jon Backstein, Bradley H. Nathan
InventorsRussell Todd Nevins, David Jon Backstein, Bradley H. Nathan
Life of this patent
Estimating the term…
Abstract
A system and method for determining a location for a surgical jig in a surgical procedure includes providing a mixed reality headset, a 3D spatial mapping camera, an infrared or stereotactic camera, and a computer system configured to transfer data to and from the mixed reality headset and the 3D spatial mapping camera. The system and method also include attaching a jig to a bone, mapping the bone and jig using the 3D spatial mapping camera, and then identifying a location for the surgical procedure using the computer system. Then the system and method use the mixed reality headset to provide a visualization of the location for the surgical procedure.
Claims30
A method for determining a location for a surgical jig in a surgical procedure, comprising:
- providing a mixed reality headset;
- providing a 3D spatial mapping camera;
- providing an imaging camera comprising one of an infrared camera or a stereotactic camera;
- providing a computer system connected to each of the mixed reality headset, 3D spatial mapping camera and imaging camera, the computer system configured to send display data to the mixed reality headset, and receive imaging data from the 3D spatial mapping camera and the imaging camera;
- creating a first digital map of a bone of a patient on which the surgical procedure is to be performed using first imaging data from the 3D spatial mapping camera combined with first coordinates data from the imaging camera;
- creating a second digital map of a physical jig to be used in the surgical procedure using second imaging data from the 3D spatial mapping camera combined with second coordinates data from the imaging camera;
- using the first digital map and the second digital map to determine a location for the surgical procedure on the bone and a position of the physical jig relative to the bone and generating a digital image of a virtual representation of the bone with a virtual representation of the jig superimposed over the virtual representation of the bone;
- displaying the virtual representation of the bone and jig on the mixed reality headset to provide a virtual visualization for indicating a location for placement of the physical jig relative to the bone;
- and
- attaching the physical jig to the bone at the location wherein the visualization of the location for the surgical procedure is indicated.
7 more elements
A method for determining a location for a surgical procedure, comprising:
- providing a mixed reality headset;
- providing a 3D spatial mapping camera;
- providing an imaging camera comprising one of an infrared camera or a stereotactic camera;
- providing a computer system connected to each of the mixed reality headset, 3D spatial mapping camera and imaging camera, the computer system configured to send display data to the mixed reality headset, and receive imaging data from the 3D spatial mapping camera and the imaging camera;
- creating a first digital map of a body part of a patient on which the surgical procedure is to be performed using first imaging data from the 3D spatial mapping camera combined with first coordinates data from the imaging camera;
- creating a second digital map representing a plurality of locations where surgical procedures are to be performed on the body part using second imaging data from the 3D spatial mapping camera combined with second coordinates data from the imaging camera;
- using the first digital map and the second digital map to determine positions of the plurality of locations relative to the body part and generating a digital image of a virtual representation of the body part with a virtual representation of the plurality of locations superimposed over the virtual representation of the body part;
- displaying the virtual representation of the body part and plurality of locations on the mixed reality headset to provide a virtual visualization for indicating a location for surgical procedure to be performed on the body part.
5 more elements
A method for determining a location for a surgical jig in a surgical procedure, comprising:
- providing a mixed reality headset;
- providing a 3D spatial mapping camera;
- providing a stereotactic camera;
- providing a computer system configured to transfer data to and from the mixed reality headset and the 3D spatial mapping camera;
- attaching a jig to a bone;
- mapping the bone and jig using the 3D spatial mapping camera;
- identifying coordinates of the location of the jig using the stereotactic camera;
- identifying a location for the surgical procedure using the computer system, which superimposes a mapping image from the 3D spatial mapping camera and a coordinates based image from the stereotactic camera;
- using the mixed reality headset to provide a visualization of the location for the surgical procedure;
- using the mixed reality headset to provide a virtual jig and a virtual bone, which are representations of the jig and bone;
- manipulating the location of the virtual jig as viewed in the mixed reality headset, with respect to the virtual bone;
- fixing the location of the virtual jig as viewed in the mixed reality headset, with respect to the virtual bone;
- wherein the jig includes a fiducial ball marker, wherein the fiducial ball is configured to be scanned by the stereotactic camera to provide data relating to the desired location of the jig;
- identifying a position of the jig with respect to the bone based, at least in part, on the data provided by scanning the fiducial ball marker;
- manipulating the location of the jig with respect to the bone, to substantially match the location of the virtual jig with respect to the virtual bone;
- and
- wherein the mixed reality headset is separate and not mechanically connected to the 3D spatial mapping camera and the stereotactic camera.
14 more elements
A method for determining a location for a surgical jig, comprising:
- providing a 3D spatial mapping camera;
- providing an infrared camera;
- providing a computer system configured to transfer data to and from the mixed reality headset, the 3D spatial mapping and the infrared camera;
- mapping a bone and a jig using the 3D spatial mapping camera;
- identifying coordinates of the location of the jig using the infrared camera;
- creating a digital map of the bone and the jig using the mapping of the jig and bone from the 3D spatial mapping camera combined with the coordinates of the location of the jig from the infrared camera;
- and
- attaching the jig to the bone.
5 more elements
Dependencies are inferred from the claim text.