Machine learning request fulfillment platform

A system, comprising:

• a requester agent of a processor;
• a plurality of provider agents of one or more processors, each provider agent comprising a generative artificial intelligence model;
• an administrator agent of a processor;
• a middleware;
• wherein the requester agent is configured to:
• generate a request for output, wherein the request is initiated when the requester agent calls an endpoint provided when a request class is generated, wherein the request is an instance of the request class;
• select a provider agent of the plurality of provider agents based at least in part on a bid value of a particular proposal object associated with the provider agent;
• provide a reward allocation to the administrator agent;
• wherein a provider agent of the plurality of provider agents is configured to:
• generate a plurality of proposal objects, wherein a proposal object of the plurality of proposal objects is generated at least in part by:
• (i) generating an input for the generative artificial intelligence model of the provider agent from the request for the output,
• (ii) processing the input using one or more decoder layers of the generative artificial intelligence model, a decoder layer comprising a self-attention layer and a feed-forward network, wherein the self-attention layer enables the decoder to generate a context-aware decoding of the input, the self-attention layer comprising a multi-headed attention mechanism including at least a first head and a second head, the first head applying a different set of weights from the second head, wherein a set of weights comprises a key weight matrix, a query weight matrix, or a value weight matrix, wherein the computations for the first head and the second head are performed in parallel, wherein the outputs for the attention layer are concatenated to pass into the feed-forward neural network,
• wherein each proposal object comprises the bid value and the output;
• wherein the bid value is included in an array in the request;
• wherein the middleware is configured to:
• forward the request for the output to the provider agent, comprising:
• maintaining an endpoint for data exchange between the requester agent and the plurality of provider agents;
• receiving the request for the output as a call;
• and translating the call to an endpoint of the provider agent using a secure mapping system;
• wherein the administrator agent is configured to:
• assign a reward to the request, wherein the reward is generated based at least in part on a probability that the requester agent will select a proposal object of the plurality of proposal objects;
• and
• provide the reward allocation to the provider agent;
• wherein the reward allocation is equal to a portion of the reward minus a first value, a second value, or a third value;
• wherein the first value is equal to the bid value,
• wherein the second value is equal to a second highest bid value among a plurality of proposal objects associated with the plurality of provider agents,
• wherein the third value is equal to a lowest bid value among the plurality of proposal objects associated with the plurality of provider agents that would have resulted in the selection of the provider agent.

A system, comprising:

• at least one data processor;
• and
• memory storing instructions that, when executed by the at least one data processor, cause the at least one data processor to perform operations comprising:
• receiving, from a requester agent of a processor of the one or more processors, a request for an output, wherein the request is initiated when the requester agent calls an endpoint provided when a request class is generated, wherein the request is an instance of the request class;
• receiving, from a plurality of provider agents of at least one of the one or more processors, a plurality of proposal objects, wherein each provider agent comprises a generative artificial intelligence model, wherein a proposal object of the plurality of proposal objects is generated at least in part by:
• (i) generating an input for the generative artificial intelligence model of the provider agent from the request for the output,
• (ii) processing the input using one or more decoder layers of the generative artificial intelligence model of the provider agent, a decoder layer comprising a self-attention layer and a feed-forward network, wherein the self-attention layer enables the decoder to generate a context-aware decoding of the input, the self-attention layer comprising a multi-headed attention mechanism including at least a first head and a second head, the first head applying a different set of weights from the second head, wherein a set of weights comprises a key weight matrix, a query weight matrix, or a value weight matrix, wherein the computations for the first head and the second head are performed in parallel, wherein the outputs for the attention layer are concatenated to pass into the feed-forward neural network,
• wherein each proposal object comprises a bid value and the output;
• wherein the bid value is included in an array in the request;
• assigning, from an administrator agent of a processor of the one or more processors, a reward to the request, wherein the reward is generated based at least in part on a probability that the requester agent will select a proposal object of the plurality of proposal objects;
• receiving, from the requester agent, a selection of a provider agent of the plurality of provider agents based at least in part on a bid value of a particular proposal object associated with the provider agent;
• forwarding the request for the output to the provider agent, the forwarding the request for the output of the provider agent comprising:
• maintaining an endpoint for data exchange between the requester agent and the plurality of provider agents;
• receiving the request for the output as a call;
• and translating the call to an endpoint of the provider agent using a secure mapping system;
• providing, to the requester agent, the output of the particular proposal object;
• and
• providing, from the administrator agent, a reward allocation to the provider agent;
• wherein the reward allocation is equal to a portion of the reward minus a first value, a second value, or a third value;
• wherein the first value is equal to the bid value,
• wherein the second value is equal to a second highest bid value among a plurality of proposal objects associated with the plurality of provider agents,
• wherein the third value is equal to a lowest bid value among the plurality of proposal objects associated with the plurality of provider agents that would have resulted in the selection of the provider agent.