Methods and systems for producing a video synopsis using clustering

A computer program product for summarizing a source video sequence, the computer program product comprising:

• a non-transitory computer readable medium having computer readable program embodied therewith, the computer readable program comprising:
• computer readable program configured to obtain a source video being a sequence of video frames which presents two or more source objects that are moving relative to a background;
• computer readable program configured to receive features descriptive of selected source objects presented in the source video sequence over a selected time interval, wherein the source objects represent moving objects appearing in the source video;
• computer readable program configured to cluster the source objects into clusters such that each one of the clusters includes source objects that are similar in respect to one of the features or a combination of the features;
• computer readable program configured to select one or more of the clusters, and further select source objects only from the selected one or more clusters;
• computer readable program configured to generate synopsis objects by sampling respective source objects;
• computer readable program configured to generate a synopsis video only from the selected synopsis objects wherein the synopsis video has a playing time which is shorter than the playing time of the source video,
• wherein two or more synopsis objects which are played at least partially simultaneously in the synopsis video, are generated from source objects that are captured at different times in the source video,
• wherein two or more synopsis objects which are played at different times in the synopsis video are generated from source objects that are captured at least partially simultaneously in the source video.

A system for summarizing a source video sequence, the system comprising:

• a computer processor configured to obtain a source video being a sequence of video frames which presents two or more source objects that are moving relative to a background;
• a source object selector executed by the computer processor and configured receive features descriptive of selected source objects presented in the source video sequence over a selected time interval, wherein the source objects represent moving objects appearing in the source video;
• a clustering unit executed by the computer processor and configured to cluster the source objects into clusters such that each one of the clusters includes source objects that are similar in respect to one of the features or a combination of the features, wherein the source object selector is further configured to select one or more of the clusters, and further select source objects only from the selected one or more clusters;
• a sampler executed by the computer processor configured to generate synopsis objects by sampling respective source objects;
• and
• a frame generator executed by the processor and configured to generate a synopsis video only from the selected synopsis objects;
• wherein the synopsis video has a playing time which is shorter than the playing time of the source video,
• wherein two or more synopsis objects which are played at least partially simultaneously in the synopsis video, are generated from source objects that are captured at different times in the source video,
• wherein two or more synopsis objects which are played at different times in the synopsis video are generated from source objects that are captured at least partially simultaneously in the source video.