Deterministic learning video scene detection
AssigneeInternational Business Machines Corporation
InventorsDaniel Nechemia Rotman, Rami Ben-Ari, Udi Barzelay
Life of this patent
Estimating the term…
Abstract
A video scene detection machine learning model is provided. A computer device receives feature vectors corresponding to audio and video components of a video. The computing device provides the feature vectors as input to a trained neural network. The computing device receives from the trained neural network, a plurality of output feature vectors that correspond to shots of the video. The computing device applies optimal sequence grouping to the output feature vectors. The computing device further trains the trained neural network based, at least in part, on the applied optimal sequence grouping.
Claims20
A computer-implemented method, the method comprising:
- receiving, by one or more processors, feature vectors corresponding to audio and video components of a video;
- providing, by one or more processors, the feature vectors as input to a trained neural network;
- receiving, by one or more processors, from the trained neural network, a plurality of output feature vectors that correspond to shots of the video;
- applying, by one or more processors, optimal sequence grouping to the output feature vectors;
- and
- further training, by one or more processors, the trained neural network based, at least in part, on the applied optimal sequence grouping.
A computer program product comprising:
- one or more computer-readable storage media and program instructions stored on the one or more computer-readable storage media, the stored program instructions comprising:
- program instructions to receive feature vectors corresponding to audio and video components of a video;
- program instructions to provide the feature vectors as input to a trained neural network;
- program instructions to receive from the trained neural network, a plurality of output feature vectors that correspond to shots of the video;
- program instructions to apply optimal sequence grouping to the output feature vectors;
- and
- program instructions to further train the trained neural network based, at least in part, on the applied optimal sequence grouping.
A computer system, the computer system comprising:
- one or more computer processors:
- one or more computer readable storage medium;
- and
- program instructions stored on the computer readable storage medium for execution by at least one of the one or more processors, the stored program instructions comprising:
- program instructions to receive feature vectors corresponding to audio and video components of a video;
- program instructions to provide the feature vectors as input to a trained neural network;
- program instructions to receive from the trained neural network, a plurality of output feature vectors that correspond to shots of the video;
- program instructions to apply optimal sequence grouping to the output feature vectors;
- and
- program instructions to further train the trained neural network based, at least in part, on the applied optimal sequence grouping.
Dependencies are inferred from the claim text.