US 9,844,321 B1 · Enhanced ophthalmic surgical experience using a virtual reality head-mounted display

Abstract

An ophthalmic surgical system comprises: a camera optically coupled to a surgical microscope; a virtual reality (VR) headset worn by a surgeon; and a VR data processing unit configured to communicate with the surgical microscope, the VR headset, and an ophthalmic surgical apparatus, wherein the VR data processing unit is configured to: project a real time video screen of video received from the camera into the VR headset; project a patient information screen into the VR headset to provide the patient information directly to the surgeon during ophthalmic surgery; project a surgical apparatus information screen into the VR headset; project a surgical apparatus input control screen into the VR headset to provide the surgeon with direct control over the surgical apparatus; and control which ones of the screens are visible in the VR headset based inputs indicating head movements of the surgeon as detected by the VR headset.

Claims24

Dependent claims

An ophthalmic surgical system, comprising:

a 3D camera optically coupled to a surgical microscope;
a virtual reality (VR) headset worn by a surgeon;
and
a VR data processing unit configured to communicate with the 3D camera, the VR headset, and an surgical apparatus for performing ophthalmic surgery on a patient, wherein the VR data processing unit is configured to:
project a real time video screen of video received from the 3D camera into the VR headset;
project a patient information screen into the VR headset to provide the patient information directly to the surgeon during ophthalmic surgery;
project a surgical apparatus information screen into the VR headset showing a current context of the surgical apparatus;
project a surgical apparatus input control screen into the VR headset that provides the surgeon with direct control over the surgical apparatus;
and
control which ones of the real time video screen, the patient information screen, the surgical apparatus information screen, and the surgical apparatus input control screen are visible in the VR headset based inputs indicating head movements of the surgeon as detected by the VR headset.

7 more elements

A method for providing an enhanced ophthalmic surgical experience for a surgeon, the method comprising:

responsive to a VR data processing unit receiving real time video from a 3D camera optically coupled to a surgical microscope, projecting, by the VR data processing unit, a real time video screen of the video received from the 3D camera into a VR headset;
responsive to the VR data processing unit receiving patient data over a network, projecting, by the VR data processing unit, a patient information screen into the VR headset during ophthalmic surgery;
responsive to the VR data processing unit receiving surgical apparatus current context information from an surgical apparatus for performing ophthalmic surgery on the patient, projecting, by the VR data processing unit, a surgical apparatus information screen into the VR headset showing the current context of the surgical apparatus;
responsive to the VR data processing unit receiving surgical apparatus information, projecting, by the VR data processing unit, a surgical apparatus input control screen into the VR headset that provides the surgeon with direct control over the surgical apparatus;
and
controlling, by the VR data processing unit, which ones of the real time video screen, the patient information screen, the surgical apparatus information screen, and the surgical apparatus input control screen are visible in the VR headset based inputs indicating head movements of the surgeon as detected by the VR headset.

3 more elements

A non-transitory computer-readable medium containing program instructions for providing an enhanced ophthalmic surgical experience for a surgeon, the program instructions for:

responsive to a VR data processing unit receiving real time video from a 3D camera optically coupled to a surgical microscope, projecting, by the VR data processing unit, a real time video screen of the video received from the 3D camera into a VR headset;
responsive to the VR data processing unit receiving patient data over a network, projecting, by the VR data processing unit, a patient information screen into the VR headset during ophthalmic surgery;
responsive to the VR data processing unit receiving surgical apparatus current context information from an surgical apparatus for performing ophthalmic surgery on the patient, projecting, by the VR data processing unit, a surgical apparatus information screen into the VR headset showing the current context of the surgical apparatus;
responsive to the VR data processing unit receiving surgical apparatus information, projecting, by the VR data processing unit, a surgical apparatus input control screen into the VR headset that provides the surgeon with direct control over the surgical apparatus;
and
controlling, by the VR data processing unit, which ones of the real time video screen, the patient information screen, the surgical apparatus information screen, and the surgical apparatus input control screen are visible in the VR headset based inputs indicating head movements of the surgeon as detected by the VR headset.

3 more elements

Dependencies are inferred from the claim text.

Enhanced ophthalmic surgical experience using a virtual reality head-mounted display

Life of this patent

Enhanced ophthalmic surgical experience using a virtual reality head-mounted display

Life of this patent

Abstract

Claims24