Systems and methods for automatically editing a video

A computer-readable medium comprising computer-program instructions for automatically editing a video data sequence to generate a video summary, the computer-program instructions being executable by a processor for:

• extracting sub-shots from the video data sequence;
• calculating importance measures for at least a portion of the sub-shots;
• identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots;
• determining a relative distribution of each sub-shot in the particular ones;
• based on relative distributions of each sub-shot of the particular ones, dropping sub-shots from the particular ones that do not have a uniform distribution with respect to other sub-shots in the particular ones;
• and
• connecting remaining sub-shots in the particular ones with respective shot transitions to generate the video summary.

A computing device for automatically editing a video data sequence to generate a video summary, the computing device comprising:

• a processor;
• and
• a memory coupled to the processor, the memory comprising computer-program instructions being executable by the processor for:
• extracting sub-shots from the video data sequence;
• calculating importance measures for at least a portion of the sub-shots;
• identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots;
• determining a relative distribution of each sub-shot in the particular ones;
• based on relative distributions of each sub-shot of the particular ones, dropping sub-shots from the particular ones that do not have a uniform distribution with respect to other sub-shots in the particular ones;
• and
• connecting remaining sub-shots in the particular ones with respective shot transitions to generate the video summary.

A method for automatically editing a video data sequence with respect to an independent music source, the method comprising:

• extracting metadata from the video data sequence and the independent music source, the metadata comprising sub-shots and sub-musics;
• calculating importance measures for at least a portion of the sub-shots;
• identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots;
• identifying respective moods for each of the sub-musics;
• matching sub-shot motion intensity to sub-music moods to identify particular ones of the sub-shots;
• aligning the particular ones with corresponding sub-musics;
• and
• fusing aligned sub-shots with corresponding sub-musics to generate an auto-edited video.

A computer-readable medium comprising computer-executable instructions for editing a video data sequence with respect to an independent music source, the computer-executable instructions comprising instructions for:

• extracting metadata from the video data sequence and the independent music source, the metadata comprising sub-shots and sub-musics;
• calculating importance measures for at least a portion of the sub-shots;
• identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots;
• identifying respective moods for each of the sub-musics;
• matching respective sub-shot motion intensities to the respective moods to identify particular ones of the sub-shots to align and fuse with the independent music source;
• aligning the particular ones with corresponding sub-musics;
• and
• fusing aligned sub-shots with corresponding sub-musics to generate an auto-edited video.

A computing device for editing a video data sequence with respect to an independent music source, the computing device comprising:

• a processor;
• and
• a memory coupled to the processor, the memory comprising computer-program instructions executable by the processor for:
• extracting metadata from the video data sequence and the independent music source, the metadata comprising sub-shots and sub-musics;
• calculating importance measures for at least a portion of the sub-shots;
• identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots;
• calculating respective moods for each of the sub-musics based on respective sub-music beats;
• matching respective sub-shot motion intensities to the respective moods to identify particular ones of the sub-shots to align and fuse with the independent music source;
• aligning the particular ones with corresponding sub-musics such that the particular ones are uniformly distributed across shots and/or scenes represented by the particular ones;
• and
• fusing aligned sub-shots with corresponding sub-musics to generate an auto-edited video.

A computing device for editing a video data sequence with respect to an independent music source, the computing device comprising:

• means for extracting metadata from the video data sequence and the independent music source, the metadata comprising sub-shots and sub-musics;
• means for calculating importance measures for at least a portion of the sub-shots;
• means for identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots;
• means for calculating respective moods for each of the sub-musics based on respective sub-music beats;
• means for matching respective sub-shot motion intensities to the respective moods to identify particular ones of the sub-shots to align and fuse with the independent music source;
• means for aligning the particular ones with corresponding sub-musics such that the particular ones are uniformly distributed across shots and/or scenes represented by the particular ones;
• and
• means for fusing aligned sub-shots with corresponding sub-musics to generate an auto-edited video.