System and method for identifying original music
AssigneeMelodis Corporation
InventorsAaron Master, Timothy P. Stonehocker
Life of this patent
Estimating the term…
Abstract
We disclose useful components of a method and system that allow identification of music from the song or sound using only the sound of the audio being played. A system built using the method and device components disclosed processes inputs sent from a mobile phone over a telephone or data connection, though inputs might be sent through any variety of computers, communications equipment, or consumer audio devices over any of their associated audio or data networks.
Claims17
A method of creating a resilient fingerprint of a reference sound or a query sound, the method including:
- using a processing device, repeatedly characterizing loudness of sound components grouped in filter banks of sample frames and residing in a computer readable memory, wherein the filter banks have a narrower frequency range and have closer mid-frequency spacing in frequencies between about 750 hz and 1450 hz than above 1500 hz or below 500 hz;
- flagging loudness peaks among the filter banks that are above cross-frequency and time masking thresholds in the sample frames, wherein the cross-frequency masking threshold for a particular frame is set relative to filter band characterizations of one or more masking sounds and the time masking threshold for successive frames is set relative to the filter band characterizations of the masking sounds;
- and
- coding the flagged loudness peaks in relation to the cross-frequency and time masking thresholds to create a frame-by-frame, filter bank-by-filter bank characteristic matrix.
A method for accurately searching music references to find a music reference which matches a query including:
- creating frame-by-frame, filter bank-by-filter bank reference characteristic matrices for numerous reference sounds and at least one frame-by-frame, filter bank-by-filter bank query characteristic matrix for a query sound;
- comparing alignments of the query characteristic matrix to at least some of the reference characteristic matrices, including identifying filter bank-by-filter bank positive peak matches, negative peak matches, peak in query but not in reference mismatches, and peak in reference but not in query mismatches;
- frame-by-frame, deriving a plurality of composite scores across filter banks that distinctly weight and combine the positive peak matches, the negative peak matches, the peak in query but not in reference characteristic mismatches and peak in reference but not in query mismatches;
- combining the frame-by-frame composite scores into query scores for the alignments and selecting one or more best alignments of the query characteristic matrix to the reference characteristic matrices;
- and
- organizing the composite scores for the best alignments to identify likely query-to-reference characteristic matrix matches.
Dependencies are inferred from the claim text.