Back to results
US 2026/0067414 A1Published application
Efficient shot detection of transitions
AssigneeMicrosoft Technology Licensing, LLC
InventorsYonit HOFFMAN, Zvi FIGOV, Eliyahu STRUGO
Life of this patent
Estimating the term…
Abstract
Systems and methods for providing efficient shot transition detection for shot segmentation of a video. A traditional shot transition detector and a neural network shot transition detector are used in multiple stages to identify transitions between shots in the video. Further, dynamic thresholds are determined based on visual attributes of the video that are used to detect cut transitions and gradual transitions.
Claims20
A computer-implemented method, comprising:
- determining transition candidates of a set of frames of a video;
- generating first scores corresponding to a first comparison of visual features of the set of frames;
- identifying a non-cut transition segment included in the transition candidates;
- identifying a gradual transition in the non-cut transition segment by comparing the first scores with a first threshold and a second threshold;
- determining shot boundaries of shots in the set of frames based on the gradual transition;
- and
- generating a list of the shot boundaries.
4 more elements
A system comprising:
- a processor;
- and
- memory storing instructions that cause the system to perform operations comprising:
- determining a set of transition candidates from frames of a video;
- performing a first comparison of visual features of the set of transition candidates using a first shot transition detector;
- generating a set of first scores based on results of the first comparison;
- identifying a non-cut transition segment included in the set of transition candidates;
- determining a first threshold and a second threshold for the non-cut transition segment;
- identifying a gradual transition in the non-cut transition segment based on the first threshold and the second threshold;
- determining shot boundaries of shots in the video based on the gradual transition;
- and generating a list of the shot boundaries.
8 more elements
A video analytics system, comprising:
- a first shot transition detector;
- a second shot transition detector;
- a processor;
- and
- memory storing instructions that cause the video analytics system to perform operations comprising:
- performing a first comparison of visual features of frames of a video using the first shot transition detector;
- generating a set of first scores based on results of the first comparison;
- determining a first threshold based on the set of first scores;
- determining a set of transition candidates from the frames based on comparing the set of first scores with the first threshold;
- performing a second comparison of the visual features of the set of transition candidates using the second shot transition detector;
- generating a set of second scores based on results of the second comparison;
- determining a second threshold based on the set of second scores;
- identifying a cut transition included in the set of second scores based on comparing the set of second scores with the second threshold;
- identifying a non-cut transition segment included in the transition candidates by identifying a peak in the set of second scores that does not satisfy the second threshold;
- determining a third threshold and a fourth threshold for the non-cut transition segment;
- identifying a first intersection and a second intersection where the third threshold intersects the set of second scores;
- identifying a third intersection proximate the first intersection and a fourth intersection proximate the second intersection, where the third threshold and the fourth threshold intersect the set of second scores;
- identifying a gradual transition as the frames from the third intersection to the fourth intersection;
- determining shot boundaries of shots in the video based on the identified cut transition and the identified gradual transition;
- and
- generating a list of the shot boundaries.
18 more elements
Dependencies are inferred from the claim text.