Language model translation and training method and apparatus
AssigneeSamsung Electronics Co., Ltd.
InventorsTae Gyoon KANG, Hodong LEE
Life of this patent
Estimating the term…
Abstract
A language model training method and an apparatus using the language model training method are disclosed. The language model training method includes assigning a context vector to a target translation vector, obtaining feature vectors based on the target translation vector and the context vector, generating a representative vector representing the target translation vector using an attention mechanism for the feature vectors, and training a language model based on the target translation vector, the context vector, and the representative vector.
Claims22
A processor implemented language model training method, comprising:
- assigning a context vector to a target translation vector;
- obtaining feature vectors based on the target translation vector and the context vector;
- generating a representative vector representing the target translation vector using an attention mechanism for the feature vectors;
- and
- training a language model based on the target translation vector, the context vector, and the representative vector.
A language model training apparatus, comprising:
- a preprocessor configured to assign a context vector to a target translation vector;
- and
- a processor configured to:
- obtain feature vectors based on the target translation vector and the context vector,
- generate a representative vector representing the target translation vector using an attention mechanism for the feature vectors, and
- train a language model based on the target translation vector, the context vector, and the representative vector.
Dependencies are inferred from the claim text.