Audio content search engine
AssigneeSonic Foundry, Inc.
InventorsMichael J. Knight, Jonathan Scott, Steven J. Yurick, John Hancock
Life of this patent
Estimating the term…
Abstract
A method of generating an audio content index for use by a search engine includes determining a phoneme sequence based on recognized speech from an audio content time segment. The method also includes identifying k-phonemes which occur within the phoneme sequence. The identified k-phonemes are stored within a data structure such that the identified k-phonemes are capable of being compared with k-phonemes from a search query.
Claims53
A method of generating an audio content index for use by a search engine, the method comprising:
- (a) determining, with a processor of an audio content search system, a phoneme sequence based on recognized speech from an audio content time segment;
- (b) identifying, with the processor, k-phonemes which occur within the phoneme sequence;
- (c) storing, in a memory of the audio content search system, the identified k-phonemes within a data structure such that the identified k-phonemes are capable of being compared with k-phonemes from a search query;
- (d) including the audio content time segment in an ordered audio content search results set, wherein an order of the audio content time segment is based at least in part on a confidence score of a valid sequence within the audio content time segment;
- and
- (e) providing the ordered audio content search results set to a multi-modal search results fusion engine.
A method of locating information within an audio content time segment comprising:
- (a) identifying, with a processor of an audio content search system, k-phonemes of a search query based on a phonetic pronunciation of the search query;
- (b) identifying, with the processor, k-phonemes within an audio content index which match the identified k-phonemes of the search query to determine an audio content index starting location, wherein the audio content index comprises phoneme data associated with an audio content time segment;
- (c) performing, with the processor, a comparison of the phonetic pronunciation to the phoneme data at the audio content index starting location to identify an audio content search result;
- (d) including the audio content time segment in an ordered audio content search results set, wherein an order of the audio content time segment is based at least in part on a confidence score of a valid sequence within the audio content time segment;
- and
- (e) providing the ordered audio content search results set to a multi-modal search results fusion engine.
A system for locating information within an audio content time segment comprising:
- (a) an audio content search application, wherein the audio content search application comprises computer code configured to
- identify k-phonemes of a search query based on a phonetic pronunciation of the search query;
- identify k-phonemes within an audio content index which match the identified k-phonemes of the search query to determine an audio content index starting location, wherein the audio content index comprises phoneme data associated with an audio content time segment;
- perform a comparison of the phonetic pronunciation to the phoneme data at the audio content index starting location to identify an audio content search result;
- include the audio content time segment in an ordered audio content search results set, wherein an order of the audio content time segment is based at least in part on a confidence score of a valid sequence within the audio content time segment;
- and
- provide the ordered audio content search results set to a multi-modal search results fusion engine
- (b) a memory configured to store the audio content search application;
- and
- (c) a processor coupled to the memory and configured to execute the audio content search application.
Dependencies are inferred from the claim text.