US 11,769,019 B1Granted

Machine translation with adapted neural networks

AssigneeAmazon Technologies, Inc.

InventorsPrashant Mathur, Georgiana Dinu, Anna Currey, Eric J. Nowell, Aakash Upadhyay, Haiyu Yao, Marcello Federico, Yaser Al-Onaizan, Rama Krishna Sandeep Pokkunuri, Jian Wang, Xianglong Huang

Life of this patent

Estimating the term…

patentgrep

Loading patent…

Abstract

A translation system receives examples of translations between a first language and a second language. In response to receiving request to translate a source text from the first language to the second language, the system ranks the examples based on the example's applicability to one or more portions of the source text. The system performs additional training of a neural network that was pre-trained to translate from the first language to the second language, where the additional training is based on one or more top-ranking examples. The system translates the source text to the second language using the additionally trained neural network.

Claims20

Dependent claims

A system, comprising:

at least one processor;
and
at least one memory, the at least one memory comprising instructions that, in response to execution by the at least one processor, cause the system to at least:
receive two or more examples of translation, wherein an example of translation comprises a first phrase in a first language and a second phrase in a second language, the second phrase a translation of the first phrase;
receive a request to translate a source text from the first language to the second language;
rank the two or more examples with respect to a plurality of examples based, at least in part, on a measure of similarity between the first phrase and one or more portions of the source text;
perform additional training of a neural network trained to translate from the first language to the second language, the additional training based at least in part on one or more top-ranking examples of the two or more examples, and at least a portion of an encoder of the neural network is unchanged during the additional training of the neural network;
and
translate, based at least in part on the additionally trained neural network, the source text from the first language to the second language.

6 more elements

A non-transitory computer-readable storage medium comprising instructions that, in response to execution by at least one processor of a computing device, cause the computing device to at least:

receive a request to translate a source text from a first language to a second language;
load, from storage, one or more examples of translations between the first language and the second language;
rank the two or more examples based, at least in part, on applicability of at least the first language of the one or more of the two or more examples to one or more portions of the source text;
perform additional training of a neural network trained to translate from the first language to the second language, the additional training based at least in part on one or more top-ranking examples of the two or more examples, and at least a portion of an encoder of the neural network is unchanged during the additional training of the neural network;
and
translate, based at least in part on the additionally trained neural network, the source text from the first language to the second language.

3 more elements

Dependencies are inferred from the claim text.