Explainable large language model routing with immutable audit trails

A method comprising:

• receiving a query from a user;
• determining a plurality of characteristics of the query, the plurality of characteristics comprising regulatory constraints for the query and performance requirements for processing the query;
• retrieving a plurality of profiles for a plurality of models, each of the plurality of profiles comprising:
• (1) performance attributes, (2) resource consumption, and (3) regulatory compliance parameters;
• applying one or more criteria to balance the resource consumption and the performance attributes of each model of the plurality of models with the performance requirements for processing the query;
• evaluating regulatory compliance by cross-referencing the regulatory compliance parameters for each model against the regulatory constraints for the query;
• selecting a particular model according to:
• (1) results of the applying of the one or more criteria and (2) results of the regulatory compliance;
• generating a structured, human-readable explanation of the selection of the particular model;
• and
• recording, in an immutable audit trail data structure, the selection of the particular model and the structured, human-readable explanation.

A system comprising:

• a storage device;
• and
• one or more processors communicatively coupled to the storage device storing instructions thereon, that cause the one or more processors to:
• receive a request from a user;
• determine a plurality of characteristics of the request, the plurality of characteristics comprising regulatory constraints for the request and performance requirements for processing the request;
• retrieve one or more profiles for one or more models, each of the one or more profiles comprising:
• (1) performance attributes, (2) resource consumption, and (3) regulatory compliance parameters;
• apply one or more criteria relating to the resource consumption and the performance attributes of the one or more models and the performance requirements for processing the request;
• evaluate regulatory compliance by cross-referencing the regulatory compliance parameters for each model against the regulatory constraints for the request;
• select a particular model according to:
• (1) results of the applying of the one or more criteria and (2) results of the regulatory compliance;
• generate a structured, human-readable explanation of the selection of the particular model;
• and
• record, in an immutable audit trail data structure, the selection of the particular model and the structured, human-readable explanation.