Distributed gpu instructions processing with network latency optimization

A system for processing graphical processing unit (GPU) instructions from remote client devices, the system comprising one or more processors configured to perform the operations of:

• receiving, by a manager service, from a client device, a request to use one or more GPUs for performing GPU operations, the request being made from a customized Accelerator API executed on the client device;
• transmitting, from a plurality of servers, to the client device an IP address for access to the GPU server;
• receiving by the GPU server from the client device, data and a memory address of the data associated with a memory address space of a computer processing unit (CPU) of the client device;
• dynamically allocating by the GPU server, corresponding data for the received data in a CPU memory of the GPU server;
• mapping the received memory address with a memory address of the CPU of the GPU server for the dynamically allocated data;
• receiving, via an Internet network, from the client device, a plurality of GPU instructions to be performed, via the GPU server on the specified GPU;
• performing by the GPU server the GPU instructions using local Accelerator API functions to perform the GPU instructions on a local GPU installed on the GPU server;
• receiving, by the GPU server, from the local GPU, output results and/or error codes based on the processing of the GPU instructions by the local GPU;
• transmitting to the client device the output results and/or error codes to the client device.