US 11,776,273 B1 · Ensemble of machine learning models for automatic scene change detection

Abstract

Techniques for automatic scene change detection are described. As one example, a computer-implemented method includes receiving a request to train an ensemble of machine learning models on a training dataset of videos having labels that indicate scene changes to detect a scene change in a video, partitioning each video file of the training dataset of videos into a plurality of shots, training the ensemble of machine learning models into a trained ensemble of machine learning models based at least in part on the plurality of shots of the training dataset of videos and the labels that indicate scene changes, receiving an inference request for an input video, partitioning the input video into a plurality of shots, generating, by the trained ensemble of machine learning models, an inference of one or more scene changes in the input video based at least in part on the plurality of shots of the input video, and transmitting the inference to a client application or to a storage location.

Claims21

Dependent claims

A computer-implemented method comprising:

receiving a request to train an ensemble of machine learning models, on a training dataset of videos having labels that indicate scene changes, to detect a scene change in a video;
partitioning each video file of the training dataset of videos into a plurality of shots;
training the ensemble of machine learning models into a trained ensemble of machine learning models based at least in part on the plurality of shots of the training dataset of videos and the labels that indicate scene changes;
receiving an inference request for an input video;
partitioning the input video into a plurality of shots;
generating, by the trained ensemble of machine learning models, an inference of one or more scene changes in the input video based at least in part on the plurality of shots of the input video;
and
transmitting the inference to a client application or to a storage location.

5 more elements

A computer-implemented method comprising:

receiving an inference request to detect one or more scene changes in an input video;
partitioning the input video into a plurality of shots;
generating, by an ensemble of machine learning models, an inference of one or more scene changes in the input video by:
generating a first feature vector for a first shot of the input video with a video machine learning model of the ensemble of machine learning models;
generating a second feature vector for a second, consecutive shot of the input video with the video machine learning model of the ensemble of machine learning models;
and
concatenating the first feature vector and the second feature vector into a concatenated feature vector, wherein the inference is based at least in part on the concatenated feature vector;
and
transmitting the inference to a client application or to a storage location.

6 more elements

A system comprising:

a content data store to store an input video;
and
a machine learning service implemented by a one or more electronic devices, the machine learning service including instructions that upon execution cause the one or more electronic devices to perform operations comprising:
receiving an inference request to detect one or more scene changes in the input video,
partitioning the input video into a plurality of shots,
generating, by an ensemble of machine learning models, an inference of one or more scene changes in the input video by:
generating a first feature vector for a first shot of the input video with a video machine learning model of the ensemble of machine learning models,
generating a second feature vector for a second, consecutive shot of the input video with the video machine learning model of the ensemble of machine learning models, and
concatenating the first feature vector and the second feature vector into a concatenated feature vector, wherein the inference is based at least in part on the concatenated feature vector, and
transmitting the inference to a client application or to a storage location.

7 more elements

Dependencies are inferred from the claim text.

Ensemble of machine learning models for automatic scene change detection

Life of this patent

Ensemble of machine learning models for automatic scene change detection

Life of this patent

Abstract

Claims21