Intent-based query and response routing between users and backend services

A non-transitory, machine-readable medium having program code stored thereon, the program code comprising instructions to:

• submit a first prompt to a set of one or more large language model (LLM) based intent classifiers to obtain at least a first intent classification, wherein the first prompt is based on a first user query received via a first interface;
• communicate the first user query to at least one of a plurality of backend services based, at least partly, on the first intent classification;
• detect a first query response from at least one of the plurality of backend services;
• determine that the first query response corresponds to the first user query;
• and
• respond to the first user query based, at least in part, on the first query response.

An apparatus comprising:

• a processor;
• and
• a machine-readable medium having instructions stored thereon that are executable by the processor to cause the apparatus to,
• submit a first prompt to a set of one or more large language model (LLM) based intent classifiers to obtain at least a first intent classification, wherein the first prompt is based on a first user query received via a first interface;
• communicate the first user query to at least one of a plurality of backend services based, at least partly, on the first intent classification;
• detect a first query response from at least one of the plurality of backend services;
• determine that the first query response corresponds to the first user query;
• and
• respond to the first user query based, at least in part, on the first query response.