Automatic transcription of musical content and real-time musical accompaniment
AssigneeHarman International Industries, Incorporated
InventorsGlen Rutledge, Peter R. Lupini, Norm Campbell
Life of this patent
Estimating the term…
Abstract
In at least one embodiment, a method of performing automatic transcription of musical content included in an audio signal received by a computing device is provided. The method includes processing, using the computing device, the received audio signal to extract musical information characterizing at least a portion of the musical content and generating, using the computing device, a plurality of musical notations representing alternative musical interpretations of the extracted musical information. The method further includes applying a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal.
Claims33
A method of performing automatic transcription of musical content included in an audio signal received by a computing device, the method comprising:
- processing, using the computing device, the received audio signal to extract musical information characterizing at least a portion of the musical content;
- generating, using the computing device, a plurality of musical notations representing different musical interpretations of the extracted musical information;
- applying a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal;
- and
- generating for each of the plurality of musical notations, a respective matching score that indicates a measure of matching the received audio signal,
- wherein selecting one of the plurality of musical notations is based on the generated plurality of matching scores.
A computer-program product to perform automatic transcription of musical content included in a received audio signal, the computer-program product comprising:
- a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to:
- process the received first audio signal to extract musical information characterizing at least a portion of the musical content;
- generate a plurality of musical notations representing different musical interpretations of the extracted musical information;
- apply a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal;
- and
- generate a score for each of the plurality of musical notations,
- wherein the one or more computer processors execute the computer-readable program code to generate the score for each of the plurality of musical notations at least partially based on matching onset locations detected in the audio signal to expected beat locations of a particular musical notation.
A musical transcription device for performing automatic transcription of musical content included in a received audio signal, the device comprising:
- one or more computer processors configured to:
- process the received audio signal to extract musical information characterizing at least a portion of the musical content;
- generate a plurality of musical notations representing different musical interpretations of the extracted musical information;
- apply a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal;
- and
- output the transcribed musical content,
- wherein plurality of musical notations differ by at least one of key signature, time signature, meter, and note values.
A method of performing automatic transcription of musical content included in an audio signal received by a computing device, the method comprising:
- processing, using the computing device, the received audio signal to extract musical information characterizing at least a portion of the musical content;
- generating, using the computing device, a plurality of musical notations representing different musical interpretations of the extracted musical information;
- applying a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal;
- and
- generating a score for each of the plurality of musical notations,
- wherein generating the score for each of the plurality of musical notations is at least partially based on matching at least one of a time location and a duration of a note or a chord detected in the audio signal to at least one of an expected time location and a duration of a note or a chord in a particular musical notation.
A method of performing automatic transcription of musical content included in an audio signal received by a computing device, the method comprising:
- processing, using the computing device, the received audio signal to extract musical information characterizing at least a portion of the musical content;
- generating, using the computing device, a plurality of musical notations representing different musical interpretations of the extracted musical information;
- applying a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal;
- and
- generating a score for each of the plurality of musical notations,
- wherein generating the score for each of the plurality of musical notations is further based on (i) matching onset locations detected in the audio signal to expected beat locations of a particular musical notation and (ii) matching at least one of a time location and a duration of a note or a chord detected in the audio signal to at least one of an expected time location and a duration of a note or a chord in the particular musical notation.
A method of performing automatic transcription of musical content included in an audio signal received by a computing device, the method comprising:
- processing, using the computing device, the received audio signal to extract musical information characterizing at least a portion of the musical content;
- generating, using the computing device, a plurality of musical notations representing different musical interpretations of the extracted musical information;
- applying a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal;
- and
- generating a score for each of the plurality of musical notations,
- wherein generating the score for each of the plurality of musical notations is at least partially based on a priori probabilities of a particular musical notation.
A method of performing automatic transcription of musical content included in an audio signal received by a computing device, the method comprising:
- processing, using the computing device, the received audio signal to extract musical information characterizing at least a portion of the musical content;
- generating, using the computing device, a plurality of musical notations representing different musical interpretations of the extracted musical information;
- applying a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal;
- and
- generating a score for each of the plurality of musical notations,
- wherein generating the score for each of the plurality of musical notations is at least partially based on a history of use.
A method of performing automatic transcription of musical content included in an audio signal received by a computing device, the method comprising:
- processing, using the computing device, the received audio signal to extract musical information characterizing at least a portion of the musical content;
- generating, using the computing device, a plurality of musical notations representing different musical interpretations of the extracted musical information;
- applying a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal;
- and
- determining, using the computing device, complementary musical information that is musically compatible with the extracted musical information,
- wherein the transcribed musical content also includes the complementary musical information.
A method of performing automatic transcription of musical content included in an audio signal received by a computing device, the method comprising:
- processing, using the computing device, the received audio signal to extract musical information characterizing at least a portion of the musical content;
- generating, using the computing device, a plurality of musical notations representing different musical interpretations of the extracted musical information;
- applying a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal;
- presenting the plurality of musical notations to an end-user of the computing device, wherein selecting one of the plurality of musical notations is performed by the end-user using an input device coupled with the computing device,
- presenting an alternative musical notation from the plurality of musical notations to an end-user of the computing device;
- and
- selecting the alternative musical notation via an input device with the computing device,
- wherein the alternative musical notation corresponds to one of a half time notation and a double time notation.
A method of performing automatic transcription of musical content included in an audio signal received by a computing device, the method comprising:
- processing, using the computing device, the received audio signal to extract musical information characterizing at least a portion of the musical content;
- generating, using the computing device, a plurality of musical notations representing different musical interpretations of the extracted musical information;
- applying a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal;
- presenting the plurality of musical notations to an end-user of the computing device, wherein selecting one of the plurality of musical notations is performed by the end-user using an input device coupled with the computing device,
- presenting an alternative musical notation from the plurality of musical notations to an end-user of the computing device;
- and
- selecting the alternative musical notation via an input device with the computing device,
- wherein the alternative musical notation corresponds to one of a 4/4 notation and a 3/4 notation.
A method of performing automatic transcription of musical content included in an audio signal received by a computing device, the method comprising:
- processing, using the computing device, the received audio signal to extract musical information characterizing at least a portion of the musical content;
- generating, using the computing device, a plurality of musical notations representing different musical interpretations of the extracted musical information;
- applying a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal;
- presenting the plurality of musical notations to an end-user of the computing device, wherein selecting one of the plurality of musical notations is performed by the end-user using an input device coupled with the computing device,
- presenting an alternative musical notation from the plurality of musical notations to an end-user of the computing device;
- and
- selecting the alternative musical notation via an input device with the computing device,
- wherein the alternative musical notation corresponds to one of a straight time and a swing time.
A musical transcription device for performing automatic transcription of musical content included in a received audio signal, the device comprising:
- one or more computer processors configured to:
- process the received audio signal to extract musical information characterizing at least a portion of the musical content;
- generate a plurality of musical notations representing different musical interpretations of the extracted musical information;
- apply a selected one of the plurality of musical notations for transcribing the musical content of the received audio signal;
- and
- output the transcribed musical content;
- and
- determine complementary musical information that is musically compatible with the extracted musical information;
- wherein output of the transcribed musical content also includes the complementary musical information.
Dependencies are inferred from the claim text.