Back to results
US 5,870,754 AGranted
Video retrieval of MPEG compressed sequences using DC and motion signatures
AssigneePhilips Electronics North America Corporation
InventorsNevenka Dimitrova, Mohamed S. Abdel-Mottaleb
Life of this patent
Estimating the term…
Abstract
Signatures from MPEG or Motion JPEG encoded video clips are extracted based on the luminance, chrominance, and motion vector values. The signatures are stored in a database, along with corresponding location, size, and time length information. The signature of a query video clip, also encoded in the MPEG or Motion JPEG format, is extracted. The signature of the query video clip is compared with the signatures stored in the meta database, with video clips having signatures similar to the signature of the query video clip identified. The video clips are then retrieved and displayed by selection of a user.
Claims21
A method comprising the steps of:
- partitioning an at least one frame of a video clip into a plurality of window pairs, each of the plurality of window pairs including a first window and a second window,
- creating at least one signature corresponding to the at least one frame based on a plurality of differences between each first window and each second window of the plurality of window pairs;
- and
- storing the at least one signature in a database.
1 more element
A method for identifying video clips similar to a query video clip, said method comprising:
- creating a signature of each of the video clips and the query video clip by partitioning an at least one frame of each of the video clips and the query video clip into a plurality of window pairs, each of the plurality of window pairs including a first window and a second window, and creating the signature corresponding to the at least one frame of each of the video clips and the query video clip based on a plurality of differences between each first window and each second window of the plurality of window pairs;
- determining a score of the similarity of the signature of each of the video clips to the signature of the query video clip;
- and
- ordering the video clips based on the score.
1 more element
A method comprising the steps of:
- creating a signature of a query video clip by partitioning an at least one frame of the query video clip into a plurality of window pairs, each of the plurality of window pairs including a first window and a second window, and creating the signature corresponding to the at least one frame of the query video clip based on a plurality of differences between each first window and each second window of the plurality of window pairs;
- comparing the signature of the query video clip to signatures of a plurality of video clips in a database;
- and
- retrieving at least one of the plurality of video clips responsive to the comparison.
1 more element
An apparatus comprising:
- a source that supplies a plurality of video clips;
- and
- an information retrieval system that:
- extracts signatures from the plurality of video clips and from a query video clip based on a difference between a first window and a second window of a plurality of window pairs of an at least one frame from each of the plurality of video clips and from the query video clip,
- identifies at least one of the plurality of video clips similar to the query video clip by comparing the signature of the query video clip to the signatures of the plurality of video clips, and
- retrieves from the video source the at least one of the plurality of video clips similar to the query video clip.
3 more elements
An apparatus comprising:
- an archival and signature extraction section that extracts a plurality of signatures from a plurality of video clips based on a difference between a first window and a second window of a plurality of window pairs of an at least one frame from each of the plurality of video clips;
- and
- a database that stores the signatures.
An apparatus comprising:
- a source that supplies video clips and video clip signatures that are based on a difference between a first window and a second window of a plurality of window pairs of an at least one frame of the video clips;
- and
- an information retrieval system that:
- extracts a query signature from a query video clip,
- compares the query signature to the video clip signatures, and
- retrieves from the video source a video clip responsive to the comparison.
3 more elements
A computer for retrieving and displaying a plurality of video clips from video sources comprising:
- a source supplying the video clips;
- an information retrieval system that:
- extracts signatures from the plurality of video clips and from a query video clip based on a difference between a first window and a second window of a plurality of window pairs of an at least one frame from each of the plurality of video clips and from the query video clip,
- identifies at least one of the plurality of video clips similar to the query video clip by comparing the signature of the query video clip to the signatures of the plurality of video clips, and
- retrieves from the source the at least one of the plurality of video clips similar to the query video clip;
- and
- a display for displaying the video clips similar to the query video clip.
4 more elements
An apparatus for retrieving and displaying a plurality of video clips from video sources, said apparatus comprising:
- a source supplying the video clips;
- an information retrieval system comprising:
- an archival and signature extraction section for encoding each of the video clips and a query video clip into an MPEG format if the query video clip and the video clips are not in the MPEG format, and extracting signatures of query video clip and the video clips, wherein the signatures of the video clips are based on a difference between DC components of windows of a frame within the video clips, and the signature of the query video clip is based on a difference between DC components of windows of a frame within the query video clip,
- a database for storing the signatures of the video clip, and
- a retrieval subsystem identifying the video clips similar to the query video clip by comparing the signature of the query video clip to the signatures of the video clips;
- and
- a display for displaying the video clips similar to the query video clip.
4 more elements
An apparatus comprising:
- a video source providing video clips, said video source comprising:
- an MPEG video server providing the video clips encoded using an MPEG encoding standard,
- a live video source providing the video clips, and
- a network source providing the video clips encoded using an encoding standard other than the MPEG encoding standard;
- a video information retrieval system, coupled to the video source, extracting signatures from the video clips and comparing a signature extracted from a query video clip to the signatures,
- said video information retrieval system comprising:
- an archival and signature extractor that:
- at least partially re-encodes, using the MPEG encoding standard, the video clips, if the video clips are not encoded using the MPEG encoding standard, and
- extracts the signatures from the video clips if the video clips are encoded or re-encoded using the MPEG encoding standard,
- wherein the signatures from the video clips are based on a difference between DC components of the MPEG encodings of windows of a frame within the video clips, and the signature from the query video clip is based on a difference between DC components of the MPEG encodings of windows of a frame within the query video clip,
- a database, coupled to the archival and signature extractor, that stores the signatures, along with identifying data of the respective video clips corresponding to the signatures, and
- a retrieval subsystem, coupled to the database, that compares the signature of a query video clip with the signatures stored in the database, and determines a similarity between the signature of the query video clip and each of the signatures stored in the database,
- said retrieval subsystem comprising:
- a similarity calculator for calculating the similarity;
- an ordering unit, coupled to the similarity calculator, for ordering the signatures based on the similarity, and
- a fetch and display unit, coupled to the ordering unit, for retrieving video clips corresponding to the signatures;
- and
- a user interface, coupled to the video retrieval subsystem, for displaying the video clips.
15 more elements
An information retrieval system comprising:
- means for connection to a source that supplies a plurality of video clips,
- means for extracting signatures from the plurality of video clips and from a query video clip based on a difference between a first window and a second window of a plurality of window pairs of an at least one frame from each of the plurality of video clips and from the query video clip,
- means for identifying at least one of the plurality of video clips similar to the query video clip by comparing the signature of the query video clip to the signatures of the plurality of video clips, and
- means for retrieving from the video source the at least one of the plurality of video clips similar to the query video clip.
1 more element
Dependencies are inferred from the claim text.