# US 2010/0167249 A1 · Surgical training simulator having augmented reality > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2010/0167249 A1 - Document ID: US20100167249A1 - Status: Published application - Kind: A1 - Application number: 12/318,599 - Filed: 2008-12-31 - Published: 2010-07-01 - Earliest claimed: 2008-12-31 - Assignees: Haptica Ltd. - Inventors: Donncha Ryan - Web page: https://patentgrep.com/patent/US20100167249A1 ## CPC - G09B 23/285: {for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas} - G09B 23/30: Anatomical models {(G09B23/281 - G09B23/288 take precedence)} - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract A surgical training device includes a body form, an optical tracking system within the body form, and a camera configured to be optically tracked and to obtain images of at least one surgical instrument located within the body form. The surgical training device further includes a computer configured to receive signals from the optical tracking system, and a display operatively coupled to the computer and operative to display the images of at least one surgical instrument and a virtual background, the virtual background depicting a portion of a body cavity, the virtual background displayed from a perspective of the camera configured to be optically tracked. ## Claims ### Claim 1 A surgical training device, comprising: a body form; an optical tracking system within the body form; a camera configured to be optically tracked and to obtain images of at least one surgical instrument located within the body form; a computer configured to receive signals from the optical tracking system; and a display operatively coupled to the computer and operative to display the images of at least one surgical instrument and a virtual background, the virtual background depicting a portion of a body cavity, the virtual background displayed from a perspective of the camera configured to be optically tracked. ### Claim 2 (depends on 1) The surgical training device of claim 1, wherein the images of the at least one surgical instrument are from a perspective of the camera configured to be optically tracked. ### Claim 3 (depends on 1) The surgical training device of claim 1, wherein the images of the at least one surgical instrument are virtual images. ### Claim 4 (depends on 1) The surgical training device of claim 1, wherein the images of the at least one surgical instrument are live video images. ### Claim 5 (depends on 1) The surgical training device of claim 1, wherein the camera configured to be optically tracked is operative within the body form for up to six degrees of freedom. ### Claim 6 (depends on 1) The surgical training device of claim 1, wherein the images of the virtual background are continual throughout at least one degree of freedom of movement of the camera configured to be optically tracked. ### Claim 7 (depends on 1) The surgical training device of claim 1, wherein the images of the virtual background are continual throughout six degrees of freedom of movement of the camera configured to be optically tracked. ### Claim 8 (depends on 1) The surgical training device of claim 1, wherein the computer is configured to generate one or more performance metrics. ### Claim 9 (depends on 8) The surgical training device of claim 8, wherein the display is operative to display the one or more performance metrics with at least one image of at least one surgical instrument. ### Claim 10 (depends on 1) The surgical training device of claim 1, wherein the computer is configured to compare the position and alignment data of the camera configured to be optically tracked with at least one digitally stored model of a camera. ### Claim 11 A method of surgical training, comprising: obtaining image data of at least one surgical instrument from a camera located within a body form; optically tracking the camera; transmitting signals corresponding to position and alignment information of the camera; receiving the signals in a computer; displaying the image data of the least one surgical instrument; and displaying from a perspective of the camera a virtual background, the virtual background depicting a portion of a body cavity. ### Claim 12 (depends on 11) The method of claim 11, wherein displaying the image data of the least one surgical instrument includes displaying from a perspective of the camera. ### Claim 13 (depends on 11) The method of claim 11, wherein displaying the image data of the at least one surgical instrument includes displaying a virtual image. ### Claim 14 (depends on 11) The method of claim 11, wherein displaying the image data of the at least one surgical instrument includes displaying a live video image. ### Claim 15 (depends on 11) The method of claim 11, wherein optically tracking the camera includes optically tracking for up to six degrees of freedom. ### Claim 16 (depends on 11) The method of claim 11, wherein displaying from a perspective of the camera a virtual background includes continually displaying throughout at least one degree of freedom of movement of the camera. ### Claim 17 (depends on 11) The method of claim 11, wherein displaying from a perspective of the camera a virtual background includes continually displaying throughout six degrees of freedom of movement of the camera. ### Claim 18 (depends on 11) The method of claim 11, further including: generating one or more performance metrics. ### Claim 19 (depends on 18) The method of claim 18, further including: displaying the one or more performance metrics with at least one image of at least one surgical instrument. ### Claim 20 A method of surgical training, comprising: obtaining image data of at least one surgical instrument from a camera located within a body form; optically tracking the camera; transmitting signals corresponding to position and alignment information of the camera; receiving the signals in a computer; generating three dimensional position and alignment data for the camera; comparing the position and alignment data with at least one digitally stored model of the at least one camera; displaying the image data of the least one surgical instrument; and displaying from a perspective of the camera a virtual background, the virtual background depicting a portion of a body cavity.