Domain-specific question answering with context reduction
AssigneeNEC Laboratories America, Inc.
InventorsBiplob Debnath, Md Adnan Arefeen, Srimat Chakradhar
Life of this patent
Estimating the term…
Abstract
Methods and systems for context reduction include identifying a context document relating to a query. A number of sentences of the context document to preserve is determined. The sentences of the context document are ranked according to respective similarities between the sentences and the query. A reduced context is generated that preserves the determined number of highest ranked sentences of the context document and eliminates other sentences from the context document. The query is executed with a language model, including the reduced context in a prompt, to generate a response.
Claims20
A computer-implemented method for context reduction, comprising:
- identifying a context document relating to a query;
- determining a number of sentences of the context document to preserve;
- ranking the sentences of the context document according to respective similarities between the sentences and the query;
- generating a reduced context that preserves the determined number of highest ranked sentences of the context document and eliminates other sentences from the context document;
- and
- executing the query with a language model, including the reduced context in a prompt, to generate a response.
A system for context reduction, comprising:
- a hardware processor;
- and
- a memory that stores a computer program which, when executed by the hardware processor, causes the hardware processor to:
- identify a context document relating to a query;
- determine a number of sentences of the context document to preserve;
- rank the sentences of the context document according to respective similarities between the sentences and the query;
- generate a reduced context that preserves the determined number of highest ranked sentences of the context document and eliminates other sentences from the context document;
- and
- execute the query with a language model, including the reduced context in a prompt, to generate a response.
Dependencies are inferred from the claim text.