Method and System for Optimizing Use of Retrieval Augmented Generation Pipelines in Generative Artificial Intelligence Applications

A system for dynamic knowledge integration in large language models (LLM) comprising:

• a processor;
• a network communication device operably coupled to the processor and configured to transmit and receive digital transmissions across a digital network;
• a dynamic knowledge base;
• and
• a non-transitory computer-readable storage medium having software stored thereon that, when executed by the processor, is operable to:
• receive multimodal input data comprising at least one of text data, image data, audio data, video data, and code data;
• instantiate a document processor operable to extract extracted information by processing the multimodal input data;
• store the extracted information in the dynamic knowledge base;
• instantiate a query processor operable to receive a user query;
• identify one or more identified knowledge domains related to the user query using a plurality of domain-specific agents;
• retrieve real-time information from the dynamic knowledge base responsive to the one or more identified knowledge domains;
• instantiate a dynamic knowledge integrator operable to integrate the real-time information into the processing of an LLM;
• and
• generate a response using a system that comprises the plurality of domain-specific agents.

A system for dynamic knowledge integration in large language model (LLM) systems comprising:

• means for receiving multimodal input data comprising at least one of text data, image data, audio data, video data, and code data;
• means for extracting extracted information by processing the multimodal input data through a document processor;
• means for storing the extracted information in a dynamic knowledge base;
• means for receiving a user query at a query processor;
• means for identifying one or more identified knowledge domains related to the user query using a plurality of domain-specific agents;
• means for retrieving real-time information from the dynamic knowledge base responsive to the one or more identified knowledge domains;
• means for integrating the real-time information into the processing of an LLM by a dynamic knowledge integrator;
• and
• means for generating a response using the system comprising the plurality of domain-specific agents.