Dynamic slice assignment in a distributed storage system

A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes said at least one processing device:

• to monitor latencies associated with processing of input-output operations in a plurality of storage nodes of a distributed storage system;
• to detect an unbalanced condition between the storage nodes based at least in part on the monitored latencies;
• and
• responsive to the detected unbalanced condition, to adjust an assignment of slices of a logical address space of the distributed storage system to the storage nodes;
• wherein the slices of the logical address space comprise respective sets of contiguous pages corresponding to respective different fractional portions of a given logical storage volume;
• wherein the different fractional portions of the given logical storage volume are stored on different ones of the storage nodes utilizing the corresponding slices assigned to that storage node;
• wherein each of at least a subset of a plurality of storage nodes of the distributed storage system comprises a set of processing modules configured to communicate with corresponding sets of processing modules on other ones of the storage nodes, the sets of processing modules of the storage nodes of the distributed storage system collectively comprising at least a portion of a distributed storage controller of the distributed storage system;
• wherein monitoring latencies associated with processing of input-output operations in the storage nodes comprises:
• obtaining latency measurements from flow control components implemented in respective ones of the processing modules implemented in respective ones of the storage nodes;
• and
• utilizing the latency measurements in a feedback loop for adjusting a choker size to limit concurrent processing of input-output operations in the distributed storage system;
• wherein one or more of the sets of processing modules each comprise at least a routing module, a control module and a data module;
• and
• wherein adjusting an assignment of slices of the logical address space of the distributed storage system to the storage nodes responsive to the detected unbalanced condition comprises modifying a number of the slices assigned to control modules of one or more of the storage nodes based at least in part on latencies of the corresponding one or more storage nodes.

A method comprising:

• monitoring latencies associated with processing of input-output operations in a plurality of storage nodes of a distributed storage system;
• detecting an unbalanced condition between the storage nodes based at least in part on the monitored latencies;
• and
• responsive to the detected unbalanced condition, adjusting an assignment of slices of a logical address space of the distributed storage system to the storage nodes;
• wherein the slices of the logical address space comprise respective sets of contiguous pages corresponding to respective different fractional portions of a given logical storage volume;
• wherein the different fractional portions of the given logical storage volume are stored on different ones of the storage nodes utilizing the corresponding slices assigned to that storage node;
• wherein each of at least a subset of a plurality of storage nodes of the distributed storage system comprises a set of processing modules configured to communicate with corresponding sets of processing modules on other ones of the storage nodes, the sets of processing modules of the storage nodes of the distributed storage system collectively comprising at least a portion of a distributed storage controller of the distributed storage system;
• and
• wherein monitoring latencies associated with processing of input-output operations in the storage nodes comprises:
• obtaining latency measurements from flow control components implemented in respective ones of the processing modules implemented in respective ones of the storage nodes;
• and
• utilizing the latency measurements in a feedback loop for adjusting a choker size to limit concurrent processing of input-output operations in the distributed storage system;
• wherein one or more of the sets of processing modules each comprise at least a routing module, a control module and a data module;
• wherein adjusting an assignment of slices of the logical address space of the distributed storage system to the storage nodes responsive to the detected unbalanced condition comprises modifying a number of the slices assigned to control modules of one or more of the storage nodes based at least in part on latencies of the corresponding one or more storage nodes;
• and
• wherein the method is performed by at least one processing device comprising a processor coupled to a memory.