System and method for semantic video segmentation based on joint audiovisual and text analysis

A system for partitioning a video into a series of semantic units wherein each semantic unit relates to a thematic topic, the system comprising:

• a video segmenting unit for dividing a video into a plurality of homogeneous segments;
• an audio and visual analyzing unit for analyzing audio and visual content of the video;
• a keyword extracting unit for extracting a plurality of keywords from speech content of each of the plurality of homogeneous segments of the video;
• and
• a detecting and merging unit for detecting and merging a plurality of groups of semantically related and temporally adjacent homogeneous segments into a series of semantic units in accordance with results of both the audio and visual analysis and the keyword extraction.

A computer program product for partitioning a video into a series of semantic units wherein each semantic unit relates to a thematic topic, the computer program product comprising:

• a computer usable medium having computer usable program code embodied therein;
• computer usable program code configured to divide a video into a plurality of homogeneous segments;
• computer usable program code configured to analyze audio and visual content of the video;
• computer usable program code configured to extract a plurality of keywords from speech content of each of the plurality of homogeneous segments of the video;
• and
• computer usable program code configured to detect and merge a plurality of groups of semantically related and temporally adjacent homogeneous segments into a series of semantic units in accordance with results of both the audio and visual analysis and the keyword extraction.