Request throttling in distributed storage systems

A computer-implemented method, comprising:

• receiving, by an access node for a distributed storage system, a plurality of file data requests, wherein:
• the access node includes a plurality of throttling paths;
• each throttling path of the plurality of throttling paths corresponds to a different priority class of file data requests;
• and
• each throttling path of the plurality of throttling paths comprises:
• a request queue configured to queue file data requests of that priority class;
• a token bucket allocated tokens for processing file data requests of that priority class;
• and
• a request gate configured to selectively pass, based on a quantity of tokens in the token bucket, file data requests to a corresponding storage manager for that priority class for processing;
• allocating a number of tokens to each token bucket based on an allocation of throughput to each throttling path of the plurality of throttling paths;
• determining, based on priority classes of the plurality of file data requests, corresponding throttling paths from the plurality of throttling paths;
• queueing the plurality of file data requests in corresponding request queues of the corresponding throttling paths;
• passing, responsive to the token bucket of any throttling path including a sufficient quantity of tokens to process a next file data request as a next object data request, the next object data request from that request queue through the request gate of that throttling path to the corresponding storage manager for that priority class in the distributed storage system;
• receiving, by the corresponding storage manager of a plurality of storage managers, data requests from a corresponding throttling path for that priority class in response to the file data requests passed by that throttling path;
• and
• simultaneously processing, by the plurality of storage managers, storage requests of different priority classes from different throttling paths to allocate a total throughput of a plurality of storage nodes of the distributed storage system.

A system, comprising:

• an access node including a plurality of throttling paths, wherein each throttling path of the plurality of throttling paths corresponds to a priority class of file data requests and comprises:
• a request queue configured to queue file data requests of that priority class;
• a token bucket allocated tokens for processing file data requests of that priority class;
• and
• a request gate configured to selectively pass, based on a quantity of tokens in the token bucket, file data requests to a corresponding storage manager for that priority class for processing;
• means for receiving a plurality of file data requests;
• means for allocating a number of tokens to each token bucket based on an allocation of throughput to each throttling path of the plurality of throttling paths;
• means for determining, based on priority classes of the plurality of file data requests, corresponding throttling paths from the plurality of throttling paths;
• means for queueing the plurality of file data requests in corresponding request queues of the corresponding throttling paths;
• means for passing, responsive to the token bucket of any throttling path including a sufficient quantity of tokens to process a next file data request as a next object data request, the next object data request from that request queue through the request gate of that throttling path to the corresponding storage manager for that priority class in a distributed storage system;
• means for receiving, by the corresponding storage manager of a plurality of storage managers, data requests from a corresponding throttling path for that priority class in response to the file data requests passed by that throttling path;
• and
• means for simultaneously processing, by the plurality of storage managers, storage requests of different priority classes from different throttling paths to allocate a total throughput of a plurality of storage nodes of the distributed storage system.