# US 2013/0157239 A1 · Augmented reality tele-mentoring (art) platform for laparoscopic training > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2013/0157239 A1 - Document ID: US20130157239A1 - Status: Published application - Kind: A1 - Application number: 13/715,113 - Filed: 2012-12-14 - Published: 2013-06-20 - Earliest claimed: 2011-12-16 - Assignees: Board of Regents of the Nevada System of Higher Education, on behalf of the University of Nevada - Inventors: Michael Russo - Web page: https://patentgrep.com/patent/US20130157239A1 ## CPC - G09B 23/28: for medicine - G09B 23/285: {for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas} - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) ## Abstract Disclosed herein are methods and systems for tele-mentoring, such as for laparoscopic training. In one example, a system includes a mentor environment and a trainee environment wherein the mentor environment is coupled to the trainee environment so that an image of the mentor laparoscopic instruments is superimposed on the trainee laparoscopic instruments allowing a mentor to provide real-time audible and visual guidance to a trainee. The mentor environment can include a training laparoscopic box simulator with a camera and mentor instructional laparoscopic instruments; a mentor audio/visual processor coupled to the mentor training laparoscopic box simulator; a mentor microphone coupled to the computing device; and a mentor display coupled to at least the computing device. The trainee environment can include a trainee system with trainee laparoscopic instruments and a video device, such as a camera; a trainee microphone coupled to the trainee system; and a trainee display coupled to the mentor environment. ## Claims ### Claim 1 A tele-mentoring system, comprising: a mentor environment, comprising: a mentor training laparoscopic box simulator comprising a mentor camera and mentor laparoscopic instruments; a mentor computing device comprising an audio/visual (A/V) processor, the computing device being coupled to the mentor training laparoscopic box simulator; a mentor microphone coupled to the computing device; and a mentor display coupled to at least the computing device, thereby forming a mentor environment; and a trainee environment, comprising: a trainee system comprising trainee laparoscopic instruments and trainee camera coupled to the mentor computing system; a trainee microphone coupled to the trainee system and the mentor computing device; and a trainee display coupled to the mentor environment thereby forming a tele-mentoring system for use in mentoring trainees to perform laparoscopic procedures, wherein the mentor environment is coupled to the trainee environment so that video generated by the mentor camera is superimposed on video generated by the trainee camera to allow for generation of a hybrid video signal comprising both the trainee laparoscopic instruments and the mentor laparoscopic instruments, which is provided, along with the mentor audio signal to the trainee display, to provide real-time audible and visual guidance to a trainee. ### Claim 2 (depends on 1) The tele-mentoring system of claim 1, wherein the trainee camera and mentor camera are oriented in the same position so that superimposing their images yields a hybrid video image to facilitate real-time visual guidance to the trainee. ### Claim 3 (depends on 1) The tele-mentoring system of claim 1, wherein the mentor environment is portable/mobile. ### Claim 4 (depends on 1) The tele-mentoring system of claim 1, wherein the mentor environment is at a remote location. ### Claim 5 (depends on 1) The tele-mentoring system of claim 1, wherein the mentor environment is coupled to the trainee environment by a network, such as a Local Area Network (LAN), Wide Area Network (WAN) or the internet. ### Claim 6 (depends on 1) The tele-mentoring system of claim 1, wherein the mentor environment is coupled to the trainee environment by a wireless communication network. ### Claim 7 (depends on 1) The tele-mentoring system of claim 1, wherein the mentor environment is coupled to the trainee environment by a wired communication network. ### Claim 8 (depends on 1) The tele-mentoring system of claim 1, wherein the mentor environment uses green screen technology for superimposition of images/data. ### Claim 9 (depends on 1) The tele-mentoring system of claim 1, wherein the mentor laparoscopic training box further comprises chroma key compositing to remove the background color of the video generated by the mentor camera. ### Claim 10 (depends on 1) The tele-mentoring system of claim 1, wherein the computing device further comprises a filter for filtering at least the video generated by the mentor camera and a signal mixer for creating a hybrid image from the video generated by the trainee camera and the video generated by the mentor camera. ### Claim 11 A method for tele-mentoring, comprising: receiving a trainee video signal from a trainee system; receiving a mentor video signal from a mentor training box simulator; receiving a mentor audio signal from a mentor microphone; generating a hybrid video signal based on the mentor video signal and the trainee video signal to generate a hybrid video signal; displaying the hybrid video signal at a mentor display; sending the hybrid video signal and the audio signal to the trainee system; and wherein the combining and the sending occurs in real time to allow for real-time audible and visual guidance of a trainee by its mentor is facilitated. ### Claim 12 (depends on 11) The method of claim 11, wherein the mentor video signal comprises an image of mentor instruments with a background having substantially uniform background color. ### Claim 13 (depends on 12) The method of claim 12, wherein the generating comprises: removing the background color of the mentor video signal using chroma key compositing to generate a filtered mentor video signal, and combining the filtered mentor video signal to the trainee video signal to generate the hybrid video signal. ### Claim 14 (depends on 11) The method for tele-mentoring of claim 11, wherein the method is a method for tele-mentoring for a laparoscopic procedure. ### Claim 15 (depends on 14) The method for tele-mentoring of claim 14, wherein the mentor training box simulator comprises laparoscopic instructional instruments. ### Claim 16 (depends on 11) The method for tele-mentoring of claim 11, wherein the mentor training box simulator is portable/mobile. ### Claim 17 (depends on 11) The method for tele-mentoring of claim 11, wherein the mentor training box is at a remote location. ### Claim 18 (depends on 11) The method for tele-mentoring of claim 11, wherein the mentor training box simulator is coupled to the trainee system by a network, such as a Local Area Network (LAN), Wide Area Network (WAN) or an internet. ### Claim 19 (depends on 11) The method for tele-mentoring of claim 11, wherein the mentor training box simulator is coupled to the trainee system by a wireless communication network. ### Claim 20 (depends on 11) The method for tele-mentoring of claim 11, further comprising filtering the mentor training box video and trainee video prior to combining the mentor training box video and trainee video to generate hybrid signal.