Streamlined Evaluation of Simultaneously Executed Artificial Intelligence Agents

A method of comparatively evaluating performance of artificial intelligence (“AI”) agents, comprising:

• receiving, at a user interface (“UI”), a selection of a first AI agent;
• causing simultaneous display, on a single screen of the UI (“UI screen”), of the first AI agent and a second AI agent, the first AI agent and second AI agent each comprising multiple agent objects, the second AI agent differing from the first AI agent by at least one agent object, wherein the multiple agent objects are simultaneously displayed in an agent topology;
• simultaneously executing the first AI agent and the second AI agent with a common series of queries, wherein an agent executor is configured to execute each agent object according to manifest files of the first AI agent and second AI agent, wherein executing each AI agent generates outputs responsive to the series of queries;
• collecting, by the agent executor, execution metrics for each executed agent object;
• and
• causing simultaneous display, on the UI screen, of the execution metrics that correspond to execution of each of the multiple agent objects of the first AI agent and the second AI agent, wherein each of the execution metrics is displayed in proximity to the respective agent object from which it was collected.

A system for comparatively evaluating performance of artificial intelligence (“AI”) agents, comprising:

• a memory storage including a non-transitory, computer-readable medium comprising instructions;
• and
• at least one hardware-based processor that executes the instructions to carry out stages comprising:
• receiving, at a user interface (“UI”), a selection of a first AI agent;
• causing simultaneous display, on a single screen of the UI (“UI screen”), of the first AI agent and a second AI agent, the first AI agent and second AI agent each comprising multiple agent objects, the second AI agent differing from the first AI agent by at least one agent object, wherein the multiple agent objects are simultaneously displayed in an agent topology;
• simultaneously executing the first AI agent and the second AI agent with a common series of queries, wherein an agent executor is configured to execute each agent object according to manifest files of the first AI agent and second AI agent, wherein executing each AI agent generates outputs responsive to the series of queries;
• collecting, by the agent executor, performance metrics for each executed agent object;
• and
• causing simultaneous display, on the UI screen, of the performance metrics that correspond to execution of each of the multiple agent objects of the first AI agent and the second AI agent, wherein each of the performance metrics is displayed in proximity to the respective agent object from which it was collected.

A non-transitory, computer-readable medium having instructions for comparatively evaluating performance of artificial intelligence (“AI”) agents, the instructions, when executed by a processor, causing the processor to perform stages comprising:

• receiving, at a user interface (“UI”), a selection of a first AI agent;
• causing simultaneous display, on a single screen of the UI (“UI screen”), of the first AI agent and a second AI agent, the first AI agent and second AI agent each comprising multiple agent objects, the second AI agent differing from the first AI agent by at least one agent object, wherein the multiple agent objects are simultaneously displayed in an agent topology;
• simultaneously executing the first AI agent and the second AI agent with a common series of queries, wherein an agent executor is configured to execute each agent object according to manifest files of the first AI agent and second AI agent, wherein executing each AI agent generates outputs responsive to the series of queries;
• collecting, by the agent executor, performance metrics for each executed agent object;
• and
• causing simultaneous display, on the UI screen, of the performance metrics that correspond to execution of each of the multiple agent objects of the first AI agent and the second AI agent, wherein each of the performance metrics is displayed in proximity to the respective agent object from which it was collected.