Temporal segment based extraction and robust matching of video fingerprints

A non-transitory computer program product for temporal, event-based video fingerprinting, the computer program product comprising:

• a computer readable medium;
• program code stored on the computer readable medium for extracting content-based features from video content, wherein the video content comprises a plurality of video frames and the content-based features are extracted from each frame of the plurality of video frames;
• program code stored on the computer readable medium for detecting events in the content-based features, wherein each event of the events represents discrete points of interest in the video content;
• program code stored on the computer readable medium for generating a set of temporal, event-based segments using the events, wherein each temporal, event-based segment is a segment of the video content covering a set of the events that span a set of at least two frames of the plurality of video frames and is aligned at an event boundary;
• program code stored on the computer readable medium for deriving a time series signal from each temporal, event-based segment in the set of temporal, event-based segments using temporal tracking of the content-based features of multiple frames associated with the each temporal, event-based segment;
• and
• program code stored on the computer readable medium for extracting a segment fingerprint based on the time series signal for each temporal, event-based segment to form a set of temporal segment based fingerprints associated with the video content.

An apparatus for automatically detecting video piracy, the apparatus comprising:

• a bus system;
• a communications system coupled to the bus system;
• a memory connected to the bus system, wherein the memory includes computer usable program code;
• and
• a processing unit coupled to the bus system, wherein the processing unit executes the computer usable program code to extract content-based features from video content, wherein the video content comprises a plurality of video frames and the content-based features are extracted from each frame of the plurality of video frames, detect events in the content-based features, wherein each event of the events represents discrete points of interest in the video content;
• generate a set of temporal, event-based segments using the events, wherein each temporal, event-based segment is a segment of the video content covering a set of the events that span a set of at least two frames of the plurality of video frames and is aligned at an event boundary;
• derive a time series signal from each temporal, event-based segment in the set of temporal, event-based segments using temporal tracking of the content-based features of multiple frames associated with the each temporal, event-based segment;
• and extract a segment fingerprint based on the time series signal for each temporal, event-based segment to form a set of temporal segment based fingerprints associated with the video content, wherein detection of the near-duplicate is used for content-based video piracy detection.