Generating representations of input sequences using neural networks

A system comprising one or more computers and one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to perform operations comprising:

• obtaining an input sequence, the input sequence comprising a plurality of inputs arranged according to an input order;
• processing the input sequence using a first long short term memory (LSTM) neural network to convert the input sequence into an alternative representation for the input sequence;
• and
• processing the alternative representation for the input sequence using a second LSTM neural network to generate a target sequence for the input sequence, the target sequence comprising a plurality of outputs arranged according to an output order.

A computer program product encoded on one or more non-transitory storage media, the computer program product comprising instructions that when executed by the one or more computers cause the one or more computers to perform operations comprising:

• obtaining an input sequence, the input sequence comprising a plurality of inputs arranged according to an input order;
• processing the input sequence using a first long short term memory (LSTM) neural network to convert the input sequence into an alternative representation for the input sequence;
• and
• processing the alternative representation for the input sequence using a second LSTM neural network to generate a target sequence for the input sequence, the target sequence comprising a plurality of outputs arranged according to an output order.