Isolating clients of distributed storage systems

A distributed storage system comprising:

• memory hosts, each memory host comprising:
• non-transitory memory;
• a network interface controller in communication with the non-transitory memory and servicing remote direct memory access requests from clients, the non-transitory memory receiving a data transfer rate from each client in communication with the memory host through remote direct memory access;
• and
• a data processor in communication with the non-transitory memory and the network interface controller, the data processor executing a host process that:
• reads each received client data transfer rate;
• receives an isolation configuration providing a bandwidth capacity for the memory host and a list of bandwidth reservations for the clients, each bandwidth reservation reserving a threshold data transfer rate for a client;
• determines a throttle data transfer rate for each client based on the isolation configuration;
• and
• writes each throttle data transfer rate to non-transitory memory accessible by the clients through remote direct memory access;
• and
• a curator in communication with the memory hosts, the curator allocating memory in the memory hosts for data chunks of a file,
• wherein in response to a memory access request from a client in communication with the memory hosts and the curator, the curator returning a file descriptor to the client that maps data chunks of a file on the memory hosts for remote direct memory access of the data chunks on the memory hosts, and
• wherein the file descriptor comprises a client key for each data chunk of the file, the client key allowing access to the corresponding data chunk on its memory host, the curator denying access to file descriptors to clients failing to adhere to their corresponding throttle data transfer rates over a period of time.

A method of isolation in a distributed storage system, the method comprising:

• receiving into non-transitory memory a data transfer rate from each client in communication with the memory through remote direct memory access;
• reading, into a data processor in communication with non-transitory memory, each received client data transfer rate;
• receiving, at the data processor, an isolation configuration providing a bandwidth capacity for the non-transitory memory and a list of bandwidth reservations for each client, each bandwidth reservation reserving a threshold data transfer rate for the corresponding client;
• determining, at the data processor, a throttle data transfer rate for each client based on the isolation configuration;
• and
• writing, from the data processor, each throttle data transfer rate to non-transitory memory accessible by each client through remote direct memory access.