System and method for comparing an input digital video to digital videos using extracted and candidate video features
AssigneeElectronics and Telecommunications Research Institute
InventorsYoung-Suk Yoon, Wonyoung Yoo, Yong-Seok Seo, Sang Kwang Lee, Jin Soo Seo, Seungjae Lee, Weon Geun Oh, Young Ho Suh
Life of this patent
Estimating the term…
Abstract
A method for managing digital videos includes extracting a feature of an input digital video, searching for candidate features having similarity to the extracted feature, and comparing the extracted feature with each of the candidate features to select at least one of the candidate features similar to the extracted feature and provide information on a digital video corresponding to the selected candidate feature.
Claims15
A machine-implemented method for managing digital videos, comprising:
- extracting a feature of an input digital video;
- searching a plurality of candidate features of a plurality of digital ideos for candidate features having similarity to the extracted feature;
- comparing the extracted feature with each of the candidate features to recognize a matching digital video of the plurality of digital videos having at least one of the candidate features similar to the extracted feature and provide information on the matching digital video corresponding to the at least one similar candidate feature;
- and
- wherein extracting the feature of an input digital video includes:
- decoding the input digital video to generate digital video frames;
- normalizing the digital video frames to a predetermined uniform size;
- and
- extracting temporal and spatial attributes from the video frames with the normalized size, the temporal and spatial attributes being used as the extracted feature, wherein extracting temporal and spatial attributes includes:
- storing the normalized frames in a frame buffer by a predetermined frame buffer size;
- dividing the stored normalized frames into 3D-based cubics with predetermined width, height and length;
- performing 3D transformation on the divided cubics;
- and
- performing linear transformation or non-linear transformation on the transformed cubics to extract the temporal and spatial attributes of the input digital video, wherein the predetermined width is determined by dividing a width of the stored normalized frames by a number of cubics in a horizontal direction, the predetermined height is determined by dividing a height of the stored normalized frames by a number of cubics in a vertical direction, and the predetermined length is equal to the predetermined frame buffer size.
A system for managing digital videos, comprising:
- a feature extracting unit for extracting a feature of an input digital video;
- a feature searching unit having a plurality of features of a plurality of digital videos for searching for candidate features having similarity to the extracted feature;
- a feature comparing unit for comparing the extracted feature with each of the candidate features to recognize a matching digital video of the plurality of digital videos having at least one of the candidate features similar to the extracted feature and provide information on the matching digital video corresponding to the at least one similar candidate feature;
- and
- wherein the feature extracting unit includes:
- a video decoder for decoding the input digital video into RGB video frames;
- a spatiotemporal sampler for normalizing the decoded video frames to a uniform size;
- and
- a feature extractor for extracting, as the feature of the input digital video, temporal and spatial attributes of the normalized video frames, wherein the feature extractor includes:
- a temporal feature extractor for extracting a temporal feature from the normalized frames;
- a spatial feature extractor for extracting a temporal feature from the normalized frames;
- and
- a spatiotemporal feature extractor for extracting a spatiotemporal feature from the normalized frames, wherein the spatiotemporal feature extractor includes:
- a frame buffer for temporarily storing the normalized frames by a predetermined buffer size;
- a cubic generator for dividing the normalized frames into 3D-based cubics with predetermined width, height and length;
- a 3D transformer for per 3D transformation on the divided Cubics;
- and
- a linear/nonlinear transformer for performing linear transformation or nonlinear transformation on the 3D transformed cubics, wherein the predetermined width is determined by dividing a width of the stored normalized frames by a number of cubics in a horizontal direction, the predetermined height is determined b dividing a height of the stored normalized frames by a number of cubics in a vertical direction, and the predetermined length is equal to the predetermined frame buffer size.
Dependencies are inferred from the claim text.