Encoder-decoder memory-augmented neural network architectures
AssigneeInternational Business Machines Corporation
InventorsJayram Thathachar, Tomasz Kornuta, Ahmet Serkan Ozcan
Life of this patent
Estimating the term…
Abstract
Memory-augmented neural networks are provided. In various embodiments, an encoder artificial neural network is adapted to receive an input and provide an encoded output based on the input. A plurality of decoder artificial neural networks is provided, each adapted to receive an encoded input and provide an output based on the encoded input. A memory is operatively coupled to the encoder artificial neural network and to the plurality of decoder artificial neural networks. The memory is adapted to store the encoded output of the encoder artificial neural network and provide the encoded input to the plurality of decoder artificial neural networks.
Claims20
A system comprising:
- an encoder artificial neural network adapted to receive an input and provide an encoded output based on the input;
- a plurality of decoder artificial neural networks, each adapted to receive an encoded input and provide an output based on the encoded input;
- and
- a memory operatively coupled to the encoder artificial neural network and to the plurality of decoder artificial neural networks, the memory adapted to store the encoded output of the encoder artificial neural network, and provide the encoded input to the plurality of decoder artificial neural networks.
A method comprising:
- jointly training each of a plurality of decoder artificial neural networks in combination with an encoder artificial neural network, wherein
- the encoder artificial neural network is adapted to receive an input and provide an encoded output based on the input to a memory, and
- each of the plurality of decoder artificial neural networks is adapted to receive an encoded input from a memory and provide an output based on the encoded input.
A method comprising:
- jointly training a subset of a plurality of decoder artificial neural networks in combination with an encoder artificial neural network, wherein
- the encoder artificial neural network is adapted to receive an input and provide an encoded output based on the input to a memory, and
- each of the plurality of decoder artificial neural networks is adapted to receive an encoded input from a memory and provide an output based on the encoded input;
- freezing the encoder artificial neural network;
- and
- separately training each of the plurality of decoder artificial neural networks in combination with the frozen encoder artificial neural network.
Dependencies are inferred from the claim text.