Language models with dynamic outputs
AssigneeNEC Laboratories America, Inc.
InventorsChristopher Malon, Christopher A White, Renqiang Min, Iain Melvin
Life of this patent
Estimating the term…
Abstract
Methods and systems for answering a query include generating first tokens in response to an input query using a language model, the first tokens including a retrieval rule. A retrieval rule is used to search for information to generate dynamic tokens. The retrieval rule in the first tokens is replaced with the dynamic tokens to generate a dynamic partial response. Second tokens are generated in response to the input query. The second tokens are appended to the dynamic partial response to generate an output responsive to the input query.
Claims20
A computer-implemented method for answering a query, comprising:
- generating first tokens in response to an input query using a language model, the first tokens including a retrieval rule;
- searching for information based on the retrieval rule to generate dynamic tokens;
- replacing the retrieval rule in the first tokens with the dynamic tokens to generate a dynamic partial response;
- generating second tokens in response to the input query;
- and
- appending the second tokens to the dynamic partial response to generate an output responsive to the input query.
A question answering system, comprising:
- a hardware processor;
- and
- a memory that stores a computer program which, when executed by the hardware processor, causes the hardware processor to:
- generate first tokens in response to an input query using a language model, the first tokens including a retrieval rule;
- search for information based on the retrieval rule to generate dynamic tokens;
- replace the retrieval rule in the first tokens with the dynamic tokens to generate a dynamic partial response;
- generate second tokens in response to the input query;
- and
- append the second tokens to the dynamic partial response to generate an output responsive to the input query.
Dependencies are inferred from the claim text.