Anatomical scanning, targeting, and visualization

A method for visualizing and targeting anatomical structures inside a patient utilizing a handheld screen device, the method comprising:

• holding the handheld screen device and manipulating a position of the handheld screen device relative to the patient, the handheld screen device comprising:
• a camera;
• and
• a display;
• orienting the camera on the handheld screen device relative to an anatomical feature of the patient by manipulating the position of the handheld screen device relative to the patient;
• capturing image data of light reflecting from a surface of the anatomical feature with the camera on the handheld screen device;
• comparing the image data with a pre-operative 3-D image of the patient to determine a location of an anatomical structure located inside the patient and positioned relative to the anatomical feature of the patient;
• displaying the anatomical feature of the patient on the display of the handheld screen device;
• and
• displaying an augmented virtual image on the display of the handheld screen device in addition to the anatomical feature of the patient, the augmented virtual image comprising at least one of:
• a virtual trajectory oriented with respect to the anatomical feature of the patient and the anatomical structure located inside the patient;
• and
• an overlay of the anatomical structure located inside the patient.

A method for visualizing and targeting anatomical structures inside a patient utilizing a handheld screen device comprising:

• a scanner, a detector, a registration module, a camera, and a display, the method comprising:
• grasping the handheld screen device relative to the patient and orienting the scanner of the handheld screen device relative to an anatomical feature of the patient;
• projecting a structured light pattern onto a surface of the anatomical feature with the scanner of the handheld screen device;
• capturing first image data of a deformed structured light pattern reflecting from the surface of the anatomical feature with the detector of the handheld screen device;
• comparing the first image data with a pre-operative 3-D image of the patient to determine a location of an anatomical structure located inside the patient and positioned relative to the anatomical feature of the patient;
• capturing second image data of the anatomical feature of the patient with the camera of the handheld screen device;
• and
• displaying the second image data of the anatomical feature of the patient on the display of the handheld screen device.