System and method for generating weighted query representations for enhanced retrieval augmented generation

A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

• processing a query using a generative artificial intelligence (AI) model;
• extracting a topic of the query;
• generating a weighting for the topic of the query;
• generating a weighted query topic embedding for the topic of the query;
• identifying a candidate chunk from a plurality of chunks of a target document by determining a similarity between the weighted query topic embedding and a plurality of chunk embeddings for the plurality of chunks;
• generating a prompt using the query and the candidate chunk;
• and
• providing the prompt to the generative AI model.