Method, device and computer program for training a machine learning model to generate text and for generating text using the trained machine learning model

Abstract

The disclosure generally relates to a computer-implemented method for training a machine learning model for text generation, the method comprising inputting text into the machine learning model; preprocessing the input text to obtain a plurality of character vector representations; encoding, using an encoder, each of the plurality of character vector representations to obtain a plurality of word vector representations; generating, using a backbone model, a plurality of predictive word vector representations based on the plurality of word vector representations; decoding, using a decoder, the plurality of predictive word vector representations to obtain a plurality of character-probabilities; and updating the machine learning model based the plurality of character-probabilities. The disclosure also relates to a computer implemented method for generating text, a corresponding device, system and computer program.

Dependencies are inferred from the claim text.