System and method for dynamic query management using meta-descriptions in a conversational search engine

A computer implemented method for searching comprising:

• establishing a conversational session over the network with a client device via a network interface, the conversational session including a plurality of messages between the client device and a search engine server;
• determining at least one parameter from a request intention within the conversational session based on natural language processing of at least one message of the plurality of messages;
• determining a meta-description based on the at least one parameter;
• select, based on the at least one parameter and the meta-description, a first plurality of nodes representing sources within a full domain of sources;
• the sources including at least one of a function call via an application programming interface (API);
• a database;
• and a large language model;
• determining at least one additional parameter based on natural language processing of at least one further message of the plurality of messages;
• adjusting, based on criteria, the first plurality of nodes into a second plurality of nodes;
• creating a query graph including the second plurality of nodes respective to a plurality of identified sources;
• and,
• executing a query to the plurality of identified sources over the network, the query based on the request intention using the query graph;
• wherein the criteria includes:
• the at least one additional parameter;
• and,
• a selected number of tokens for creation of the query graph;
• the selected number of tokens being:
• i) less than an original number of tokens for the first plurality of nodes, such that the query produces an equivalent result using either the first plurality of nodes or the second plurality of nodes;
• and,
• ii) determined by a token limitation algorithm that configures a large language model engine to operate within a predefined token range;
• the token limitation algorithm dynamically reallocating saved tokens to represent additional sources within the query graph without necessitating multiple calls.

A non-transitory computer readable medium storing a plurality of programming instructions for a search engine server implementing a method for:

• establishing a conversational session over a network with a client device via a network interface, the conversational session including a plurality of messages between the client device and the search engine server;
• determining at least one parameter from a request intention within the conversational session based on natural language processing of at least one message of the plurality of messages;
• determining a meta-description based on the at least one parameter;
• select, based on the at least one parameter and the meta-description, a first plurality of nodes representing sources within a full domain of sources;
• the sources including at least one of a function call via an application programming interface (API);
• a database;
• and a large language model;
• determining at least one additional parameter based on natural language processing of at least one further message of the plurality of messages;
• adjusting, based on criteria, the first plurality of nodes into a second plurality of nodes;
• creating a query graph including the second plurality of nodes respective to a plurality of identified sources;
• and,
• executing a query to the plurality of identified sources over the network, the query based on the request intention using the query graph;
• wherein the criteria includes:
• the at least one additional parameter;
• and,
• a selected number of tokens for creation of the query graph;
• the selected number of tokens being:
• i) less than an original number of tokens for the first plurality of nodes, such that the query produces an equivalent result using either the first plurality of nodes or the second plurality of nodes;
• and,
• ii) determined by a token limitation algorithm that configures a large language model engine to operate within a predefined token range;
• the token limitation algorithm dynamically reallocating saved tokens to represent additional sources within the query graph without necessitating multiple calls.