Generating coded data representations using neural networks and vector quantizers

A method performed by one or more computers, the method comprising:

• receiving a respective coded representation of each of a plurality of feature vectors representing an audio waveform,
• wherein the coded representation of each feature vector comprises a plurality of codebook symbols each identifying a respective code vector from a respective codebook of a vector quantizer in a sequence of vector quantizers;
• generating a respective quantized representation of each feature vector from each of the code vectors identified by the coded representation of the feature vector;
• and
• processing the quantized representations of the feature vectors using a decoder neural network to generate an estimate of the audio waveform.

A system comprising one or more computers and one or more storage devices communicatively coupled to the one or more computers, wherein the one or more storage devices store instructions that, when executed by the one or more computers, cause the one or more computers to perform operations comprising:

• receiving a respective coded representation of each of a plurality of feature vectors representing an audio waveform,
• wherein the coded representation of each feature vector comprises a plurality of codebook symbols each identifying a respective code vector from a respective codebook of a vector quantizer in a sequence of vector quantizers;
• generating a respective quantized representation of each feature vector from each of the code vectors identified by the coded representation of the feature vector;
• and
• processing the quantized representations of the feature vectors using a decoder neural network to generate an estimate of the audio waveform.

One or more non-transitory computer storage media storing instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:

• receiving a respective coded representation of each of a plurality of feature vectors representing an audio waveform,
• wherein the coded representation of each feature vector comprises a plurality of codebook symbols each identifying a respective code vector from a respective codebook of a vector quantizer in a sequence of vector quantizers;
• generating a respective quantized representation of each feature vector from each of the code vectors identified by the coded representation of the feature vector;
• and
• processing the quantized representations of the feature vectors using a decoder neural network to generate an estimate of the audio waveform.