Method and device with natural language processing

A device, the device comprising:

• a memory storing a natural language processing model;
• and
• a processor configured to:
• perform a word embedding of an input sentence;
• encode a result of the word embedding, using an encoder of the natural language processing model, to generate a context embedding vector;
• decode the context embedding vector, using a decoder of the natural language processing model, to generate an output sentence corresponding to the input sentence;
• generate a score indicating a relationship between the context embedding vector and each of a plurality of knowledge embedding vectors;
• determine a first loss based on the output sentence;
• determine a second loss based on the generated score;
• and
• perform a training of the natural language processing model, including:
• a training of the natural language processing model based on the determined first loss;
• and
• a training of the natural language processing model based on the determined second loss.

A device comprising:

• a memory storing a natural language processing model;
• and
• a processor configured to:
• perform word embedding on an input sentence;
• generate a context embedding vector by encoding a result of the word embedding using an encoder of the natural language processing model;
• and
• generate an output sentence corresponding to the input sentence by decoding the context embedding vector using a decoder of the natural language processing model,
• wherein respective results of each of the word embedding and the generating of the context embedding vector include information of one or more words of the sentence and knowledge information associated with the input sentence.

A device comprising:

• a processor configured to:
• generate a context embedding vector by encoding, using an encoder of a natural language processing model, a result of an embedding of an input sentence;
• decode the context embedding vector using a decoder of the natural language processing model;
• and
• perform one or more operations of the device based on a result of the decoding of the context embedding vector,
• wherein the context embedding vector respectively represents knowledge information and context of the input sentence, and
• wherein the result of the embedding of the input sentence represents embedded one or more words of the input sentence and knowledge information of the one or more words of the input sentence.