# US 2010/0167250 A1 · Surgical training simulator having multiple tracking systems > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2010/0167250 A1 - Document ID: US20100167250A1 - Status: Published application - Kind: A1 - Application number: 12/318,602 - Filed: 2008-12-31 - Published: 2010-07-01 - Earliest claimed: 2008-12-31 - Assignees: Haptica Ltd. - Inventors: Donncha Ryan; Derek Cassidy - Web page: https://patentgrep.com/patent/US20100167250A1 ## CPC - G09B 23/285: {for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas} - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract A surgical training device, includes a body form, at least two cameras configured to obtain image data of at least one implement located within the body form, and a magnetic tracking system operative to transmit signals, the signals corresponding to position and alignment information of the at least one implement. The surgical training device also includes a computer configured to receive the image data from the at least two cameras, receive the signals from the magnetic tracking system, and generate position and alignment data of the at least one implement from the image data and the signals. A display is operatively coupled to the computer and operative to display at least one image of the at least one implement and a virtual background, the virtual background depicting a portion of a body cavity. ## Claims ### Claim 1 A surgical training device, comprising: a body form; at least two cameras configured to obtain image data of at least one implement located within the body form; a magnetic tracking system operative to transmit signals, the signals corresponding to position and alignment information of the at least one implement; a computer configured to receive the image data from the at least two cameras, receive the signals from the magnetic tracking system, and generate from the image data and the signals position and alignment data of the at least one implement; and a display operatively coupled to the computer and operative to display at least one image of the at least one implement and a virtual background, the virtual background depicting a portion of a body cavity. ### Claim 2 (depends on 1) The surgical training device of claim 1, wherein the at least one image of the at least one implement is a virtual image, the image of the at least one implement being based on the generated position and alignment data of the at least one implement. ### Claim 3 (depends on 1) The surgical training device of claim 1, wherein the at least one image of the at least one implement is a live video image. ### Claim 4 (depends on 1) The surgical training device of claim 1, wherein the computer is configured to compare the position and alignment data of the at least one implement with at least one digitally stored model of an implement. ### Claim 5 (depends on 1) The surgical training device of claim 1, wherein the computer is configured to compare position and alignment data from the image data with position and alignment data from the magnetic tracking system. ### Claim 6 (depends on 1) The surgical training device of claim 1, wherein the computer is configured to generate one or more performance metrics. ### Claim 7 (depends on 7) The surgical training device of claim 7, wherein the display is operative to display the one or more performance metrics with the at least one image of the at least one implement. ### Claim 8 (depends on 1) The surgical training device of claim 1, wherein the display is operative to display a recorded image of one or more surgical instruments with the at least one image of the at least one implement. ### Claim 9 (depends on 1) The surgical training device of claim 1, wherein the computer is configured to receive a digital stream comprising position and alignment data of one or more instruments from a second body form. ### Claim 10 A method of surgical training, comprising: optically tracking at least one implement located within a body form; magnetically tracking the at least one implement; generating position and alignment data of the at least one implement from the optical tracking and the magnetic tracking; and displaying at least one image of the at least one implement and a virtual background, the virtual background depicting a portion of a body cavity. ### Claim 11 (depends on 10) The method of claim 10, wherein displaying at least one image of the at least one implement includes displaying a virtual image, the image of the at least one implement being based on the generated position and alignment data of the at least one implement. ### Claim 12 (depends on 10) The method of claim 10, wherein displaying at least one image of the at least one implement includes displaying a live video image. ### Claim 13 (depends on 10) The method of claim 10, further including: comparing the position and alignment data of the at least one implement with at least one digitally stored model of an implement. ### Claim 14 (depends on 10) The method of claim 10, further including: comparing position and alignment data from the optical tracking with position and alignment data from the magnetic tracking. ### Claim 15 (depends on 10) The method of claim 10, further including: generating one or more performance metrics. ### Claim 16 (depends on 15) The method of claim 15, further including: displaying the one or more performance metrics with the at least one image of the at least one implement. ### Claim 17 (depends on 10) The method of claim 10, further including: displaying a recorded image of one or more surgical instruments with the at least one image of the at least one implement. ### Claim 18 (depends on 10) The method of claim 10, further including: receiving a digital stream comprising position and alignment data of one or more instruments from a second body form. ### Claim 19 A method of surgical training, comprising: optically tracking at least one implement located within a body form; generating a first set of position and alignment data of the at least one implement using stereo triangulation techniques; magnetically tracking the at least one implement, the magnetic tracking generating a second set of position and alignment data of the at least one implement; comparing the first set of position and alignment data with the second set of position and alignment data and generating a third set of position and alignment data; comparing the third set of position and alignment data with at least one digitally stored model of an implement; generating a set of three dimensional data fields; and displaying at least one image of the at least one implement and a virtual background, the virtual background depicting a portion of a body cavity.