Language processing method and apparatus
AssigneeSamsung Electronics Co., Ltd.
InventorsMin-Joong LEE, Hodong LEE
Life of this patent
Estimating the term…
Abstract
A language processing method and apparatus is disclosed. A language processing apparatus using a neural network may obtain context information from a source text using a neural network-based encoder, generate a prefix token from the context information using a neural network-based main decoder, generate a token sequence including at least two successive tokens sequentially following the prefix token using a skip model in response to the prefix token satisfying a preset condition, and indicate a target text in which the prefix token and the token sequence are combined as an inference result with respect to the source text.
Claims41
A processor implemented method for language processing using a neural network, the method comprising:
- obtaining context information from a source text using a neural network-based encoder;
- generating a prefix token from the context information using a neural network-based main decoder;
- in response to the prefix token satisfying a preset condition, generating a token sequence including at least two successive tokens sequentially following the prefix token using a skip model;
- and
- indicating a target text in which the prefix token and the token sequence are combined as an inference result with respect to the source text.
A language processing apparatus comprising:
- one or more processors configured to:
- generate context information from a source text using a neural network-based encoder;
- generate a prefix token from the context information using a neural network-based main decoder;
- in response to the prefix token satisfying a preset condition, generate the token sequence sequentially following the prefix token using a skip model configured to generate a token sequence including at least two successive tokens;
- and
- indicate a target text in which the prefix token and the token sequence are combined as an inference result with respect to the source text.
A processor implemented method for language processing using a neural network, the language processing method comprising:
- decoding tokens from context information for a source text using a neural network-based main decoder, including sequentially decoding one or more tokens to identify a prefix token;
- sequentially following the decoding of the one or more tokens, selectively controlling the decoding of the tokens to be one of performed sequentially, to generate a next token sequentially following the decoding of the one or more tokens, and performed non-sequentially in bulk, to skip decoding of plural next tokens sequentially following the decoding of the one or more tokens;
- and
- identifying a target text based on a combination of the prefix token with a select one of the next token and the plural next tokens dependent on the selective control of the decoding of the tokens.
Dependencies are inferred from the claim text.