Resource utilization estimation and allocation for multi-agent computational systems

A method comprising:

• receiving a request from a user;
• determining, based on the request, a plurality of agentic approaches for processing the request, wherein each agentic approach comprises a sequence of multiple models configured to process the request;
• determining a subset of the plurality of agentic approaches, wherein the subset comprises agentic approaches that comply with one or more operational policies indicating resource allocation constraints;
• generating, for each agentic approach of the subset, a resource utilization estimate and a performance estimate, wherein the resource utilization estimate represents an anticipated resource consumption of each agentic approach and the performance estimate represents a value of an expected output from each agentic approach;
• and
• executing, based on the resource utilization estimate and the performance estimate for each agentic approach, a particular agentic approach of the subset, wherein the particular agentic approach optimizes the resource utilization estimate and the performance estimate.

A system comprising:

• a storage device;
• and
• one or more processors communicatively coupled to the storage device storing instructions thereon, that cause the one or more processors to:
• receive a request from a user;
• determine, based on the request, a plurality of agentic approaches for processing the request, wherein each agentic approach comprises a sequence of multiple models configured to process the request;
• determine a subset of the plurality of agentic approaches, wherein the subset comprises agentic approaches that comply with one or more operational policies indicating resource allocation constraints;
• generate, for each agentic approach of the subset, a resource utilization estimate and a performance estimate, wherein the resource utilization estimate represents an anticipated resource consumption of each agentic approach and the performance estimate represents a value of an expected output from each agentic approach;
• and
• execute, based on the resource utilization estimate and the performance estimate for each agentic approach, a particular agentic approach of the subset, wherein the particular agentic approach optimizes the resource utilization estimate and the performance estimate.