Orchestrator with semantic-based request routing for use in response generation using a trained generative language model

A computing system for managing specialized tasks and information retrieval processes, the computing system comprising:

• processing circuitry configured to:
• execute a plurality of agents, each agent configured to perform tasks and/or retrieve information in a specialized domain based on natural language input;
• cause an interaction interface for a trained generative model to be instantiated;
• receive, via the interaction interface, a message from a user for the trained generative model;
• extract a context of the message;
• generate a request including the context and the message;
• execute an orchestrator configured to:
• receive the request;
• determine, based on the context, one or more agents of the plurality of agents to handle the request;
• input the request into the one or more agents of the plurality of agents to perform a task and/or retrieve information in specialized domains of the one or more agents;
• generate a prompt based on the retrieved information and/or the performed task and the message from the user;
• provide the prompt to the trained generative model;
• receive, in response to the prompt, a response from the trained generative model;
• and
• output the response to the user.

A computing method for managing specialized tasks and information retrieval processes, the computing method comprising:

• executing a plurality of agents, each agent configured to perform tasks and/or retrieve information in a specialized domain based on natural language input;
• causing an interaction interface for a trained generative model to be presented;
• receiving, via the interaction interface, a message from a user for the trained generative model;
• extracting a context of the message;
• generating a request including the context and the message;
• executing an orchestrator configured to:
• receive the request;
• determine, based on the context, one or more agents of the plurality of agents to handle the request;
• input the request into the one or more agents of the plurality of agents to perform a task and/or retrieve information in specialized domains of the one or more agents;
• generating a prompt based on the retrieved information and/or the performed task and the message from the user;
• providing the prompt to the trained generative model;
• receiving, in response to the prompt, a response from the trained generative model;
• and
• outputting the response to the user.