# US 2018/0322854 A1 · Automated Melody Generation for Songwriting

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322854 A1
- Document ID: US20180322854A1
- Status: Published application
- Kind: A1
- Application number: 15/973,970
- Filed: 2018-05-08
- Published: 2018-11-08
- Earliest claimed: 2017-05-08
- Assignees: WaveAI Inc.
- Applicants: WaveAI Inc.
- Inventors: Margareta Ackerman; David Loker; Christopher Cassion
- Web page: https://patentgrep.com/patent/US20180322854A1

## CPC

- G10H 1/0025: {Automatic or semi-automatic music composition, e.g. producing random music, applying rules from music theory or modifying a musical piece (automatically producing a series of tones G10H1/26)}
- G06N 5/04: Inference or reasoning models
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 3/02: Neural networks
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06N 20/00: Machine learning
- G06N 20/20: Ensemble learning
- G10H 2210/066: for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
- G10H 2210/071: for rhythm pattern analysis or rhythm style recognition
- G10H 2210/111: Automatic composing, i.e. using predefined musical rules
- G10H 2210/341: Rhythm pattern selection, synthesis or composition
- G10H 2250/311: Neural networks for electrophonic musical instruments or musical processing, e.g. for musical recognition or control, automatic composition or improvisation
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

The subject disclosure relates to automated songwriting. In some aspects, a process of the disclosed technology can include steps for training a melody prediction model for selecting melodies for lyrics using a corpus of songs, the melody prediction model including modeled melody features and corresponding modeled patterns of lyric features, receiving lyric input of lyrics including a pattern of lyric features from a user, applying the melody prediction model to the lyric input to automatically generate one or more melodies for the lyric input by matching the pattern of lyric features in the lyric input to a first subset of the modeled melody features using the corresponding modeled patterns of lyric features of the modeled melody features, and providing the one or more melodies to the user to generate a song using the lyrics.

## Claims

### Claim 1

A system for providing automated songwriting, the system comprising:
one or more processors; and
a non-transitory memory coupled to the one or more processors, the memory comprising instructions stored therein, which when executed by the processors, cause the processors to perform operations comprising:
training a melody prediction model for selecting melodies for lyrics using a corpus of songs, the melody prediction model including modeled melody features and corresponding modeled lyric features;
receiving lyric input of lyrics including lyric features from a user;
applying the melody prediction model to the lyric input to automatically generate one or more melodies for the lyric input by generating probability distributions of melody features based on the lyric features in the lyrics input using the melody prediction model and selecting melody features from the probability distributions of melody features to form the one or more melodies; and
providing the one or more melodies to the user to generate a song using the lyrics.

### Claim 2 (depends on 1)

The system of claim 1, wherein the melody prediction model includes a combination of an octave model including modeled octave features, a pitch model including modeled pitch features, and a rhythm model including modeled rhythm features, and the one or more processors are further configured for performing operations comprising: applying the octave model to the lyric input to generate the one or more melodies;
applying the rhythm model to the lyric input to generate the one or more melodies based on applying the octave model to the lyric input; and
applying the pitch model to the lyric input to generate the one or more melodies based on applying the octave model and the rhythm model to the lyric input.

### Claim 3 (depends on 1)

The system of claim 1, wherein the melody prediction model includes a rhythm model and an interval model and the one or more processors are further configured for performing operations comprising:
applying the interval model to the lyric input to generate the one or more melodies; and
applying the rhythm model to the lyric input to generate the one or more melodies based on applying the interval model to the lyric input.

### Claim 4 (depends on 1)

The system of claim 1, wherein the corpus of songs are songs within a specific style of music and the one or more processors are further configured for performing operations comprising:
training the melody prediction model for selecting the melodies for the lyrics from the corpus of songs using a language model of a specific language.

### Claim 5 (depends on 1)

The system of claim 1, wherein the one or more processors are further configured for performing operations comprising:
receiving, from the user, input indicating values of one or more tunable melody creation parameters for customizing automatic generation of a melody; and
applying the melody prediction model to the lyric input according to the values of the one or more tunable melody creation parameters to automatically generate the one or more melodies based on the lyric input for the user.

### Claim 6 (depends on 1)

The system of claim 1, wherein the one or more melodies include a plurality of melodies and the one or more processors are further configured for operations further comprising:
assigning corresponding internal quality scores to the plurality of melodies, wherein the corresponding internal quality scores are assigned to the plurality of melodies based on both a sequence likelihood of corresponding sequences of notes of the plurality of melodies and an amount of note entropy across notes in the corresponding sequences of notes of the plurality of melodies; and
reproducing the plurality of melodies to the user based on the corresponding internal quality scores assigned to the plurality of melodies.

### Claim 7 (depends on 1)

The system of claim 1, wherein the one or more processors are further configured for performing operations comprising:
receiving, from the user, additional lyric input of additional lyrics for the song;
applying the melody prediction model to the additional lyric input to automatically generate one or more additional melodies for the additional lyric input; and
providing the one or more additional melodies for the additional lyric input to the user to generate the song using the lyrics, the additional lyrics, and the one or more melodies automatically generated for the lyrics.

### Claim 8 (depends on 7)

The system of claim 7, wherein the one or more processors are further configured for performing operations comprising:
receiving, from the user, an indication of a selected melody of the one or more melodies provided to generate the song using the lyrics; and
automatically generating the one or more melodies for the additional lyric input based on the selected melody.

### Claim 9 (depends on 1)

The system of claim 1, wherein the one or more processors are further configured for performing operations comprising:
adding the song to the corpus of songs created by the user with the one or more melodies; and
updating the melody prediction model based on the song added to the corpus of songs.

### Claim 10

A method for providing automated songwriting, the method comprising:
training a melody prediction model for selecting melodies for lyrics using a corpus of songs, the melody prediction model including modeled melody features and corresponding modeled lyric features;
receiving lyric input of lyrics including lyric features from a user;
applying the melody prediction model to the lyric input to automatically generate one or more melodies for the lyric input by generating probability distributions of melody features based on the lyric features in the lyrics input using the melody prediction model and selecting melody features from the probability distributions of melody features to form the one or more melodies; and
providing the one or more melodies to the user to generate a song using the lyrics.

### Claim 11 (depends on 10)

The method of claim 10, wherein the melody prediction model includes a combination of an octave model including modeled octave features, a pitch model including modeled pitch features, and a rhythm model including modeled rhythm features, the method further comprising:
applying the octave model to the lyric input to generate the one or more melodies;
applying the rhythm model to the lyric input to generate the one or more melodies based on applying the octave model to the lyric input; and
applying the pitch model to the lyric input to generate the one or more melodies based on applying the octave model and the rhythm model to the lyric input.

### Claim 12 (depends on 10)

The method of claim 10, further comprising:
receiving, from the user, input indicating values of one or more tunable melody creation parameters for customizing automatic generation of a melody; and
applying the melody prediction model to the lyric input according to the values of the one or more tunable melody creation parameters to automatically generate the one or more melodies based on the lyric input for the user.

### Claim 13 (depends on 10)

The method of claim 10, wherein the one or more melodies include a plurality of melodies, the method further comprising:
assigning corresponding internal quality scores to the plurality of melodies, wherein the corresponding internal quality scores are assigned to the plurality of melodies based on both a sequence likelihood of corresponding sequences of notes of the plurality of melodies and an amount of note entropy across notes in the corresponding sequences of notes of the plurality of melodies; and
reproducing the plurality of melodies to the user based on the corresponding internal quality scores assigned to the plurality of melodies.

### Claim 14 (depends on 10)

The method of claim 10, further comprising:
receiving, from the user, additional lyric input of additional lyrics for the song;
applying the melody prediction model to the additional lyric input to automatically generate one or more additional melodies for the additional lyric input; and
providing the one or more additional melodies for the additional lyric input to the user to generate the song using the lyrics, the additional lyrics, and the one or more melodies automatically generated for the lyrics.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
receiving, from the user, an indication of a selected melody of the one or more melodies provided to generate the song using the lyrics; and
automatically generating the one or more melodies for the additional lyric input based on the selected melody.

### Claim 16

A non-transitory computer-readable storage medium, having embodied thereon a program executable by one or more processors to perform operations comprising:
training a melody prediction model for selecting melodies for lyrics using a corpus of songs, the melody prediction model including modeled melody features and corresponding modeled lyric features;
receiving lyric input of lyrics including lyric features from a user;
applying the melody prediction model to the lyric input to automatically generate one or more melodies for the lyric input by generating probability distributions of melody features based on the lyric features in the lyrics input using the melody prediction model and selecting melody features from the probability distributions of melody features to form the one or more melodies; and
providing the one or more melodies to the user to generate a song using the lyrics.

### Claim 17 (depends on 16)

The non-transitory computer-readable storage medium, of claim 16, wherein the melody prediction model includes a combination of an octave model including modeled octave features, a pitch model including modeled pitch features, and a rhythm model including modeled rhythm features, and the one or more processors are further configured for performing operations comprising:
applying the octave model to the lyric input to generate the one or more melodies;
applying the rhythm model to the lyric input to generate the one or more melodies based on applying the octave model to the lyric input; and
applying the pitch model to the lyric input to generate the one or more melodies based on applying the octave model and the rhythm model to the lyric input.

### Claim 18 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the one or more processors are further configured for performing operations comprising:
receiving, from the user, input indicating values of one or more tunable melody creation parameters for customizing automatic generation of a melody; and
applying the melody prediction model to the lyric input according to the values of the one or more tunable melody creation parameters to automatically generate the one or more melodies based on the lyric input for the user.

### Claim 19 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the one or more melodies include a plurality of melodies and the one or more processors are further configured for performing operations comprising:
assigning corresponding internal quality scores to the plurality of melodies, wherein the corresponding internal quality scores are assigned to the plurality of melodies based on both a sequence likelihood of corresponding sequences of notes of the plurality of melodies and an amount of note entropy across notes in the corresponding sequences of notes of the plurality of melodies; and
reproducing the plurality of melodies to the user based on the corresponding internal quality scores assigned to the plurality of melodies.

### Claim 20 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the one or more processors are further configured for performing operations comprising:
receiving, from the user, additional lyric input of additional lyrics for the song;
applying the melody prediction model to the additional lyric input to automatically generate one or more additional melodies for the additional lyric input; and
providing the one or more additional melodies for the additional lyric input to the user to generate the song using the lyrics, the additional lyrics, and the one or more melodies automatically generated for the lyrics.
