Method and system for synchronizing procedure videos for comparative learning

A system for synchronizing the playback of a recorded video of a surgical procedure with a live video feed of a user performing the surgical procedure, the system comprising:

• one or more processors;
• and
• a memory coupled to the one or more processors, wherein the memory stores instructions that, when executed by the one or more processors, cause the system to:
• simultaneously receive a recorded video of a surgical procedure and a live video feed of a user performing the surgical procedure in a training session, wherein the recorded video is shown to the user as a training reference, and wherein the surgical procedure includes a set of surgical tasks;
• simultaneously monitor the playback of a current surgical task in the set of surgical tasks in the recorded video and the live video feed depicting the user performing the current surgical task;
• detect that the end of the current surgical task has been reached during the playback of the recorded video;
• determine whether the user has completed the current surgical task based on the live video feed;
• and
• responsive to determining that the user has not completed the current surgical task, automatically pause the playback of the recorded video while awaiting the user to complete the current surgical task.

A virtual reality (VR) device for synchronizing the playback of a recorded video of a surgical procedure with a live video feed of a user performing the surgical procedure in an immersive display, the VR device comprising:

• a split-screen VR display comprising a left-half display and a right-half display;
• one or more processors;
• and
• a memory coupled to the one or more processors, wherein the memory stores instructions that, when executed by the one or more processors, cause the VR device to:
• simultaneously receive a recorded video of a surgical procedure and a live video feed of a user performing the surgical procedure in a training session, wherein the recorded video is shown to the user as a training reference, and wherein the surgical procedure includes a set of surgical tasks;
• simultaneously monitor the playback of a current surgical task in the set of surgical tasks in the recorded video on the left-half display and the live video feed depicting the user performing the current surgical task on the right-half display;
• detect that the end of the current surgical task has been reached during the playback of the recorded video on the left-half display;
• determine whether the user has completed the current surgical task based on the live video feed;
• and
• responsive to determining that the user has not completed the current surgical task, automatically pause the playback of the recorded video while awaiting the user to complete the current surgical task.