Generating multi-track music from text prompts with diffusion models

Abstract

Methods, systems, and devices for multi-track music generation are described. In some examples, a method includes receiving a text prompt describing desired musical attributes and generating, using a diffusion model, multiple audio tracks based on the text prompt, wherein each audio track corresponds to a different musical component. The method can further include assigning individual timestep vectors respectively to each of multiple audio tracks and generating, using a diffusion model, one or more enhanced audio tracks based on the individual timestep vectors and corresponding audio track. Finally, the method can include combining the generated audio tracks to produce a multi-track musical composition.

Dependencies are inferred from the claim text.