Proficiency and native language-adapted grammatical error correction

A method for training a grammatical error correction model, the method comprising:

• inputting, to a digital model, a first dataset that comprises domain-independent training data that comprises a set of uncorrected text items and for an uncorrected text item, a corresponding corrected text item, and a second dataset that comprises in-domain training data that comprises a set of text sequences and, for a text sequence, a set of corresponding features, the set of corresponding features comprising a proficiency label and a native language label, wherein at least one type of error is present in the text sequences and the location of the error within the text sequences for the in-domain training data, and wherein the digital model comprises fluency-adjusted grammatical error correction model;
• training the digital model to generate grammatically corrected and fluency-adjusted text sequences using an encoder-decoder neural network with an attention mechanism and at least one long term short term memory (LSTM) unit, including first training on the first dataset from text sequences of a plurality of different topics and writing styles received from by native and non-native speakers of various native backgrounds, fine-tuning training on the second dataset;
• the digital model comprising a plurality of artificial neural network layers and model parameters associated with the artificial neural network layers, a value of a model parameter indicative of a relationship between the proficiency label, or a proficiency label-native language label combination, and the text sequence, and the corresponding corrected text item;
• and
• fine-tuning the digital model using an in-domain data set comprising text sequences that have been labeled with native languages and proficiency levels to only adjust a subset of the values of the model parameters associated with an encoding layer or an embedding layer or both the encoding layer and the embedding layer, the subset comprising one or more of a number of epochs, batch size, learning rate, and start decay.

A method, comprising:

• receiving, by a digital model, an input text sequence in a first language, wherein the digital model comprises a fluency-adjusted grammatical error correction model;
• the digital model machine-learned to generate grammatically corrected and fluency-adjusted text sequences using a first data set that comprises a set of uncorrected text sequences and for an uncorrected text sequence, a corresponding corrected text sequence, from text sequences of a plurality of different topics and writing styles received from by native and non-native speakers of various native backgrounds, the set of uncorrected text sequences comprising at least one word produced by a person whose first native language is different from the first language;
• fine-tuning the digital model using an in-domain data set to adjust values of model parameters associated with only a subset of the digital model after being machine-learned using the first data set, the in-domain data set comprising a set of text sequences and, for a text sequence, a set of corresponding features comprising a proficiency label and a native language label wherein at least one type of error is present in the first text sequence and the location of the error within the first text sequence for the in-domain training data, the subset comprising one or more of a number of epochs, batch size, learning rate, and start decay;
• and
• outputting, by the digital model, an output text sequence in the first language, the output text sequence comprising the input text sequence modified by any one or more of:
• deleting text from the input text sequence, the modifying comprising grammatical correction and fluency adjustment of the first text sequence based on a particular native language and proficiency level;
• adding text to the input text sequence;
• modifying text of the input text sequence;
• reordering text of the input text sequence;
• adding a digital markup to the input text sequence.