Back to results
US 12,567,394 B2Granted
Converting audio samples to full song arrangements
AssigneeLemon Inc.
InventorsBochen Li, Andrew Shaw, Jitong Chen
Life of this patent
Estimating the term…
Abstract
In examples, a method for converting audio samples to full song arrangements is provided. The method includes receiving audio sample data, determining a melodic transcription, based on the audio sample data, and determining a sequence of music chords, based on the melodic transcription. The method further includes generating a full song arrangement, based on the sequence of music chords, and the audio sample data.
Claims20
A method for converting audio samples to full song arrangements, the method comprising:
- receiving audio sample data;
- determining a melodic transcription with a plurality of bars, based on the audio sample data;
- determining a sequence of music chords, based on the melodic transcription, wherein the determining of the sequence of music chords comprises:
- inputting the melodic transcription to a machine learning model, the machine learning model being trained based on a dataset of paired melody bars and chords;
- receiving from the machine learning model, a plurality of chord candidates for each bar of the plurality of bars of the melodic transcription;
- determining, from pre-defined chord progressions, one or more chord progressions corresponding to the plurality of chord candidates for each bar of the plurality of bars of the melodic transcription;
- and
- selecting the sequence of music chords from the determined one or more chord progressions;
- performing vocal processing on the audio sample data by dynamically time warping the audio sample data to fit the determined sequence of music chords;
- and
- generating a full song arrangement, based on the sequence of music chords and the vocally processed audio sample data.
8 more elements
A system for converting audio samples to full song arrangements, the system comprising:
- at least one processor;
- and
- memory storing instructions that, when executed by the at least one processor, causes the system to perform a set of operations, the set of operations including:
- receiving audio sample data;
- determining a melodic transcription with a plurality of bars, based on the audio sample data;
- determining a sequence of music chords, based on the melodic transcription, wherein the determining of the sequence of music chords comprises:
- inputting the melodic transcription to a machine learning model, the machine learning model being trained based on a dataset of paired melody bars and chords;
- receiving from the machine learning model, a plurality of chord candidates for each bar of the plurality of bars of the melodic transcription;
- determining, from pre-defined chord progressions, one or more chord progressions corresponding to the plurality of chord candidates for each bar of the plurality of bars of the melodic transcription;
- and
- selecting the sequence of music chords from the determined one or more chord progressions;
- performing vocal processing on the audio sample data by dynamically time warping the audio sample data to fit the determined sequence of music chords;
- and
- generating a full song arrangement, based on the sequence of music chords and the vocally processed audio sample data.
11 more elements
One or more computer readable non-transitory storage media embodying software that is operable when executed, by at least one processor of a device, to:
- receive audio sample data;
- determine a melodic transcription with a plurality of bars, based on the audio sample data;
- determine a sequence of music chords, based on the melodic transcription, wherein to determine the sequence of music chords comprises:
- inputting the melodic transcription to a machine learning model, the machine learning model being trained based on a dataset of paired melody bars and chords;
- receiving from the machine learning model, a plurality of chord candidates for each bar of the plurality of bars of the melodic transcription;
- determining, from pre-defined chord progressions, one or more chord progressions corresponding to the plurality of chord candidates for each bar of the plurality of bars of the melodic transcription;
- and
- selecting the sequence of music chords from the determined one or more chord progressions;
- perform vocal processing on the audio sample data by dynamically time warping the audio sample data to fit the determined sequence of music chords;
- and
- generate a full song arrangement, based on the sequence of music chords and the vocally processed audio sample data.
8 more elements
Dependencies are inferred from the claim text.