Generalized validation framework for retrieval augmented generation (rag)

A system of validating a Retrieval Augmented Generation (RAG) system, the system comprising a processor configured to:

• receive rephrased text extracted from a database and rephrased by the RAG system in response to a user query;
• search and extract corresponding sections from an original document corresponding to the rephrased text;
• convert the rephrased text and the corresponding sections of the original document into semantic vectors using natural language processing techniques;
• apply a sliding window to the semantic vectors of the corresponding sections of the original document;
• calculate a semantic similarity score between the vectorized rephrased text and the vectorized text within the sliding window;
• rank sentences of the corresponding sections based on their semantic similarity scores;
• identify the sentences that have semantic congruence with the rephrased text;
• compare the semantic similarity score to a predetermined threshold;
• validating the rephrased text based on the comparison;
• and
• adjust the sliding window based on the rephrased text.