Multimedia scene break detection

A method for computer vision analysis of a media item, comprising:

• receiving a request for scene break detection on the media item;
• performing audio break detection on an audio component of the media item to obtain a set of audio break timestamps corresponding to aurally similar segments of the audio component;
• identifying a set of video break timestamps, each corresponding to at least one frame of a video component of the media item;
• identifying a set of candidate scene break timestamps corresponding to instances of the set of the audio break timestamps and the set of video break timestamps within a predefined proximity;
• executing, by a computer processor, a computer vision scoring model for each candidate scene break timestamp of the set of candidate scene break timestamps by:
• identifying a first subset of the set of contiguous shots preceding the candidate scene break timestamp and a second subset of the set of contiguous shots succeeding the candidate scene break timestamp;
• calculating a score for the candidate scene break timestamp representing a visual distance between the first subset of contiguous shots and the second subset of contiguous shots;
• and
• selecting, based at least on the score of each of the set of candidate scene break timestamps, a final set of scene break timestamps for performing a media action.

A non-transitory computer-readable storage medium comprising a plurality of instructions for computer vision analysis of a media item, the plurality of instructions configured to execute on at least one computer processor to enable the at least one computer processor to:

• receive a request for scene break detection on the media item;
• perform audio break detection on an audio component of the media item to obtain a set of audio break timestamps corresponding to aurally similar segments of the audio component;
• identify a set of video break timestamps, each corresponding to at least one frame of a video component of the media item;
• identify a set of candidate scene break timestamps corresponding to instances of the set of the audio break timestamps and the set of video break timestamps within a predefined proximity;
• execute a computer vision scoring model for each candidate scene break timestamp of the set of candidate scene break timestamps by:
• identifying a first subset of the set of contiguous shots preceding the candidate scene break timestamp and a second subset of the set of contiguous shots succeeding the candidate scene break timestamp;
• calculating a score for the candidate scene break timestamp representing a visual distance between the first subset of contiguous shots and the second subset of contiguous shots;
• and
• select, based at least on the score of each of the set of candidate scene break timestamps, a final set of scene break timestamps for performing a media action.