Generating audio using neural networks

One or more non-transitory computer-readable storage media encoded with instructions that when executed by one or more computers cause the one or more computers to implement a neural network system,

• wherein the neural network system is configured to generate an output sequence of audio data that comprises a respective audio sample at each of a plurality of time steps, and
• wherein the neural network system comprises:
• a convolutional subnetwork comprising one or more audio-processing convolutional neural network layers, wherein the convolutional subnetwork is configured to, for each of the plurality of time steps:
• receive a current sequence of audio data that comprises the respective audio sample at each time step that precedes the time step in the output sequence, and
• process the current sequence of audio data to generate an alternative representation for the time step;
• and
• an output layer, wherein the output layer is configured to, for each of the plurality of time steps:
• receive the alternative representation for the time step, and
• process the alternative representation for the time step to generate an output that defines a score distribution over a plurality of possible audio samples for the time step.

A method of generating an output sequence of audio data that comprises a respective audio sample at each of a plurality of time steps,

• wherein the method comprises, for each of the plurality of time steps:
• providing a current sequence of audio data as input to a convolutional subnetwork comprising one or more audio-processing convolutional neural network layers,
• wherein the current sequence comprises the respective audio sample at each time step that precedes the time step in the output sequence, and
• wherein the convolutional subnetwork is configured to, for each of the plurality of time steps:
• receive the current sequence of audio data, and
• process the current sequence of audio data to generate an alternative representation for the time step;
• and
• providing the alternative representation for the time step as input to an output layer, wherein the output layer is configured to, for each of the plurality of time steps:
• receive the alternative representation for the time step, and
• process the alternative representation for the time step to generate an output that defines a score distribution over a plurality of possible audio samples for the time step.