Artificial neural network with side input for language modelling and prediction

An electronic device comprising:

• a processor, and
• at least one input interface configured to receive one or more input sequence items;
• wherein the processor is configured to:
• implement an artificial neural network;
• estimate an initial state of the artificial neural network based on a side input, wherein the side input is configured to maintain a record of input sequence items received at the input interface;
• and
• generate one or more predicted next items in a sequence of items using the artificial neural network by providing an input sequence item received at the at least one input interface as input to the artificial neural network.

A computer-implemented method comprising:

• receiving one or more input sequence items using at least one input interface;
• implementing, at a processor, an artificial neural network;
• estimating an initial state of the artificial neural network based on a side input, wherein the side input is configured to maintain a record of input sequence items received at the input interface;
• and
• generating one or more predicted next items in a sequence of items using the artificial neural network by providing an input sequence item received at the at least one input interface as input to the artificial neural network.