US 12,596,873 B2 · Optimization of retrieval augmented generation using data-driven templates

Abstract

Systems and methods are disclosed herein for compressing a prompt. In an example system, an importance score listing is obtained that includes a score indicative of an importance of a plurality of dataset keywords. From the importance score listing, a keyword importance score is identified for a plurality of keywords in a current text fragment, such as a text fragment to be compressed. A set of placeholders in an abstract prompt template is populated based on the current text fragment. The current text fragment is compressed based on the importance of the plurality of keywords in the current text fragment to generate a compressed text fragment. In an example, the compressed text fragment is included in the prompt for transmission to a computing entity, such as a large language model of a generative question-answering system.

Claims20

Dependent claims

A system for compressing a prompt, the system comprising:

a processor;
and
a memory device that stores program code structured to cause the processor to:
obtain an importance score listing that includes a score indicative of an importance of a plurality of dataset keywords;
identify, from the importance score listing, a keyword importance score for a plurality of keywords in a current text fragment;
populate a set of placeholders in an abstract prompt template based on the current text fragment;
and
compress the populated abstract prompt template based on the keyword importance score for the plurality of keywords in the current text fragment to generate a compressed text fragment, the compressed text fragment included in the prompt for transmission to a computing entity.

5 more elements

Dependencies are inferred from the claim text.

Optimization of retrieval augmented generation using data-driven templates

Life of this patent

Optimization of retrieval augmented generation using data-driven templates

Life of this patent

Abstract

Claims20