Multiple stage indexing of audio content

A system comprising:

• at least one processor;
• and
• a non-transitory computer-readable medium storing executable instructions that, when executed, cause the at least one processor to perform operations comprising:
• determining a plurality of clusters based on a comparison of a plurality of audio contents using a first matching criteria, each cluster of the plurality of clusters comprising at least two audio contents from the plurality of audio contents;
• for each cluster of the plurality of clusters, determining a representative audio content for the cluster from the at least two audio contents of the cluster;
• loading the corresponding representative audio content of each cluster in the plurality of clusters into an index, the index including the representative audio content stored in association with a hash value, the hash value based on permutations of a binary vector formed using a spectral representation of the audio content;
• generating a first comparison of a query audio content to each one of the representative audio contents in the index using the first matching criteria, the first comparison including at a comparison of at least one of a content duration ratio, a bit error rate at a matching location, or a length of matching positions;
• matching the query audio content to one of the representative audio contents based on the generated first comparison;
• determining the corresponding cluster of the matched one of the representative audio contents;
• generating a second comparison of the query audio content to each one of the at least two audio contents of the determined corresponding cluster of the matched one of the representative audio contents using a second matching criteria different from the first matching criteria;
• and
• identifying a match between the query audio content and at least one of the audio contents of the determined corresponding cluster of the matched one of the representative audio contents based on the generated second comparison of the determined corresponding cluster using the first and the second matching criteria, the match used to determine similarity of the queried audio content to the representative audio content;
• wherein the determining the plurality of clusters comprises comparing fingerprint data of each of the plurality of audio contents using the first matching criteria, the comparison including a granular comparison based on a sub-cluster of each of the plurality of clusters.

A non-transitory machine-readable storage medium, tangibly embodying a set of instructions that, when executed by at least one processor, causes the at least one processor to perform operations comprising:

• determining a plurality of clusters based on a comparison of a plurality of audio contents using a first matching criteria, each cluster of the plurality of clusters comprising at least two audio contents from the plurality of audio contents;
• for each cluster of the plurality of clusters, determining a representative audio content for the cluster from the at least two audio contents of the cluster;
• loading the corresponding representative audio content of each cluster in the plurality of clusters into an index, the index including the representative audio content stored in association with a hash value, the hash value based on permutations of a binary vector formed using a spectral representation of the audio content;
• generating a first comparison of a query audio content to each one of the representative audio contents in the index using the first matching criteria, the first comparison including a comparison of at least one of a content duration ratio, a bit error rate at a matching location, or a length of matching positions;
• matching the query audio content to one of the representative audio contents based on the generated first comparison;
• determining the corresponding cluster of the matched one of the representative audio contents;
• generating a second comparison of the query audio content to each one of the at least two audio contents of the determined corresponding cluster of the matched one of the representative audio contents using a second matching criteria different from the first matching criteria;
• and
• identifying a match between the query audio content and at least one of the audio contents of the determined corresponding cluster of the matched one of the representative audio contents based on the generated second comparison of the determined corresponding cluster using the first and the second matching criteria, the match used to determine similarity of the queried audio content to the representative audio content;
• wherein the determining the plurality of clusters comprises comparing fingerprint data of each of the plurality of audio contents using the first matching criteria, the comparison including a granular comparison based on a sub-cluster of each of the plurality of clusters.