Federated Artificial Intelligence System For Request Processing Using A Model Chain

A non-transitory computer readable medium storing instructions operable to cause one or more processors to perform operations comprising:

• performing, using a first machine learning model of a model chain, a first inference operation to produce first output based on a user request;
• determining, using a scoring machine learning model configured to measure quality of output produced by machine learning models of the model chain, that the first output fails to meet a threshold;
• performing, using a second machine learning model of the model chain based on the first output failing to meet the threshold, a second inference operation to produce second output based on the user request, wherein the second machine learning model is a higher computational complexity model than the first machine learning model;
• determining, using the scoring machine learning model, that the second output meets the threshold;
• and
• transmitting, based on the second output meeting the threshold, the second output in response to the user request.

A system, comprising:

• a memory subsystem storing instructions;
• and
• processing circuitry configured to execute the instructions to
• perform, using a first machine learning model of a model chain, a first inference operation to produce first output based on a user request;
• determine, using a scoring machine learning model configured to measure quality of output produced by machine learning models of the model chain, that the first output fails to meet a threshold;
• perform, using a second machine learning model of the model chain based on the first output failing to meet the threshold, a second inference operation to produce second output based on the user request, wherein the second machine learning model has a higher computational complexity than the first machine learning model;
• determine, using the scoring machine learning model, that the second output meets the threshold;
• and
• transmit, based on the second output meeting the threshold, the second output in response to the user request.