Accelerator service catalog and orchestration

A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:

• identifying an accelerator service instance associated with a workload;
• calling a service broker associated with the accelerator service instance to obtain information needed to use the accelerator service instance;
• receiving an accelerator call, and accelerator job information concerning an accelerator job, from the workload;
• in response to the accelerator call, spinning up a new process dedicated to the accelerator job;
• as part of the new process, running the accelerator job using either the accelerator service instance, or a locally available accelerator;
• and
• returning data, generated by running the accelerator job, to the workload.