US 11,677,909 B2 · Method and system for synchronizing playback of two recorded videos of the same surgical procedure

Abstract

This disclosure provides techniques of synchronizing the playback of two recorded videos of the same surgical procedure. In one aspect, a process for generating a composite video from two recorded videos of a surgical procedure is disclosed. This process begins by receiving a first and second surgical videos of the same surgical procedure. The process then performs phase segmentation on each of the first and second surgical videos to segment the first and second surgical videos into a first set of video segments and a second set of video segments, respectively, corresponding to a sequence of predefined phases. Next, the process time-aligns each video segment of a given predefined phase in the first video with a corresponding video segment of the given predefined phase in the second video. The process next displays the time-aligned first and second surgical videos for comparative viewing.

Claims24

Dependent claims

A computer-implemented method for synchronizing playback of two recorded surgical videos of a same surgical procedure, the method comprising:

receiving a first surgical video of a surgical procedure and a second surgical video of the same surgical procedure, wherein the surgical procedure includes a sequence of predefined phases;
performing phase segmentation on each of the first and the second surgical videos to segment the first and the second surgical videos into a first set of video segments and a second set of video segments, respectively corresponding to the sequence of predefined phases;
time-aligning each video segment of a given predefined phase in the first set of video segments with a corresponding video segment of the given predefined phase in the second set of video segments, which includes:
determining a first number of video frames in a given video segment in the first surgical video;
determining a second number of video frames in a corresponding video segment in the second surgical video;
and
determining a first frame rate for playing back the given video segment in the first surgical video or a second frame rate for playing back the corresponding video segment in the second surgical video based on the first number and the second number of video frames, so that a first playback time of the given video segment is substantially equal to a second playback time of the corresponding video segment;
and
displaying the time-aligned first and second surgical videos for comparative viewing.

6 more elements

An apparatus for synchronizing playback of two recorded surgical videos of a same surgical procedure, the apparatus comprising:

one or more processors;
and
a memory coupled to the one or more processors, wherein the memory stores instructions that, when executed by the one or more processors, cause the apparatus to:
receive a first surgical video of a surgical procedure and a second surgical video of the same surgical procedure, wherein the surgical procedure includes a sequence of predefined phases;
perform phase segmentation on each of the first and the second surgical videos to segment the first and the second surgical videos into a first set of video segments and a second set of video segments, respectively, corresponding to the sequence of predefined phases;
time-align each video segment of a given predefined phase in the first set of video segments with a corresponding video segment of the given predefined phase in the second set of video segments, which includes:
determining a first number of video frames in a given video segment in the first surgical video;
determining a second number of video frames in a corresponding video segment in the second surgical video;
and
determining a first frame rate for playing back the given video segment in the first surgical video or a second frame rate for playing back the corresponding video segment in the second surgical video based on the first number and the second number of video frames, so that a first playback time of the given video segment is substantially equal to a second playback time of the corresponding video segment;
and
display the time-aligned first and second surgical videos for comparative viewing.

9 more elements

A system for synchronizing playback of two recorded surgical videos of a same surgical procedure, the system comprising:

a display device;
one or more processors;
and
a memory coupled to the one or more processors, wherein the memory stores instructions that, when executed by the one or more processors, cause the system to:
receive a first surgical video of a surgical procedure and a second surgical video of the same surgical procedure, wherein the surgical procedure includes a sequence of predefined phases;
perform phase segmentation on each of the first and the second surgical videos to segment the first and the second surgical videos into a first set of video segments and a second set of video segments, respectively, corresponding to the sequence of predefined phases;
time-align each video segment of a given predefined phase in the first set of video segments with a corresponding video segment of the given predefined phase in the second set of video segments, which includes:
determining a first number of video frames in a given video segment in the first surgical video;
determining a second number of video frames in a corresponding video segment in the second surgical video;
and
determining a first frame rate for playing back the given video segment in the first surgical video or a second frame rate for playing back the corresponding video segment in the second surgical video based on the first number and the second number of video frames, so that a first playback time of the given video segment is substantially equal to a second playback time of the corresponding video segment;
and
display the time-aligned first and second surgical videos for comparative viewing.

10 more elements