Data center resource orchestration using serverless application programming interfaces

A system comprising:

• one or more processing devices to perform operations comprising:
• maintaining, by a controller, a plurality of queues for a plurality of workers implemented using a plurality of cluster environments, each cluster environment hosting an agent that communicates with the controller and having graphics processing unit (GPU) resources accessible to at least a subset of the plurality of workers;
• storing a first execution request of an entity in a first queue of the plurality of queues, the first execution request of the entity being associated with a first cloud function, and the first queue of the plurality of queues being associated with the first cloud function;
• receiving a first execution result corresponding to the first execution request of the entity from a first worker of the plurality of workers implemented using a first cluster environment of the plurality of cluster environments;
• and
• causing the first execution result to be provided to the entity.

A processor comprising one or more processing units to:

• maintain, by a controller, a plurality of queues for a plurality of workers implemented using a plurality of cluster environments, each cluster environment hosting an agent that communicates with the controller and having graphics processing unit (GPU) resources accessible to a subset of the plurality of workers;
• store a first execution request of an entity in a first queue of the plurality of queues, the first execution request of the entity being associated with a first cloud function, and the first queue of the plurality of queues being associated with the first cloud function;
• receive a first execution result corresponding to the first execution request of the entity from a first worker of the plurality of workers implemented using a first cluster environment of the plurality of cluster environments;
• and
• cause the first execution result to be provided to the entity.