Searching multi-media databases using multi-media queries

A multi-media searching system, comprising:

• a query component that calculates responsibility vectors for frames of a query segment, the query component providing a query profile based, at least in part, upon the responsibility vectors of the frames;
• a segment component that retrieves responsibility vectors for segments of files, the segment component generating segment profiles of at least one segment of the files, a segment profile for a segment being based, at least in part, upon responsibility vectors of the segment;
• and,
• a sort component that provides information associated with a likelihood that a particular file includes the query segment based, at least in part, upon the query profile and a segment profile of a segment of the particular file.

A method for generating a responsibility vector, comprising:

• extracting subband signals from frames of a segment;
• fitting a mixture model to the extracted subband signals, for each frame;
• and,
• generating a responsibility vector for each frame based, at least in part, upon responsibility of mixture components of the mixture model.

A method for storing responsibility vectors, comprising:

• extracting subband signals from frames of segments of files;
• extracting features from the extracted subband signals;
• clustering files based, at least in part, upon vector quantization of the extracted features;
• fitting a mixture model to the extracted subband signals, for each frame;
• and,
• generating a responsibility vector for each frame based, at least in part, upon responsibility of mixture components of the mixture model.

A method for searching a multi-media database, comprising:

• calculating responsibility vectors for frames of a query segment;
• generating a query profile based, at least in part, upon the responsibility vectors of the frames;
• generating segment profiles of at least one segment of files, a segment profile for a segment being based, at least in part, upon responsibility vectors of the segment;
• and,
• providing information associated with a likelihood that a particular file includes the query segment based, at least in part, upon the query profile and a segment profile of a segment of the particular file.

A computer readable medium storing computer executable components of a multi-media responsibility vector generation system, comprising:

• a subband extractor component that extracts subband signals from frames of files, the files comprising at least one of audio information and video information;
• a feature extractor component that forms a feature vector for at least some of the frames based, at least in part, upon features extracted from the subband signals;
• a feature cluster component that clusters the files based, at least in part, upon vector quantization of the extracted features;
• and,
• a responsibility vector generator component that generates a responsibility vector for at least some of the frames based, at least in part, upon responsibility of mixture components fitted to a mixture model for the frame.

A computer readable medium storing computer executable components of a multi-media searching system, comprising:

• a query component that calculates responsibility vectors for frames of a query segment, the query component providing a query profile based, at least in part, upon the responsibility vectors of the frames;
• a segment component that retrieves responsibility vectors for segments of files, the segment component generating segment profiles of at least one segment of the files, a segment profile for a segment being based, at least in part, upon responsibility vectors of the segment;
• and,
• a sort component that provides information associated with a likelihood that a particular file includes the query segment based, at least in part, upon the query profile and a segment profile of a segment of the particular file.

A multi-media responsibility vector generation system, comprising:

• means for extracting subband signals from frames of files, the files comprising at least one of audio information and video information;
• means for extracting a features and forming a feature vector for at least some of the frames based, at least in part, upon features extracted from the subband signals;
• means for clustering the files based, at least in part, upon vector quantization of the extracted features;
• and,
• means for generating a responsibility vector for at least some of the frames based, at least in part, upon responsibility of mixture components fitted to a mixture model for the frame.

A multi-media searching system, comprising:

• means for calculating responsibility vectors for frames of a query segment;
• means for calculating a query profile based, at least in part, upon the responsibility vectors of the frames;
• means for retrieving responsibility vectors for segments of files;
• means for generating segment profiles of at least one segment of the files, a segment profile for a segment being based, at least in part, upon responsibility vectors of the segment;
• and,
• means for providing information associated with a likelihood that a particular file includes the query segment based, at least in part, upon the query profile and a segment profile of a segment of the particular file.