Host multi-path layer with proxy volume redirection for enhanced scalability of distributed storage systems

A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device comprising a processor coupled to a memory, causes the at least one processing device:

• to associate a logical storage volume with at least one path between a host and at least a given one of a plurality of storage nodes of a distributed storage system, each of the storage nodes storing corresponding portions of the logical storage volume and one or more additional logical storage volumes, a given such logical storage volume being stored in a distributed manner over the storage nodes with different address ranges of the given logical storage volume being stored in different ones of the storage nodes;
• to associate a proxy volume with respective sets of one or more paths from the host to each of the plurality of storage nodes of the distributed storage system;
• to obtain an input-output operation directed to the logical storage volume;
• and
• to redirect the input-output operation to the proxy volume over a selected one of the paths associated with the proxy volume;
• wherein the host is configured to expose a first number of paths to at least one application executing on the host, the first number of paths being determined collectively across all of the logical storage volumes accessible to the at least one application;
• and
• wherein associating the proxy volume with the respective sets of one or more paths from the host to each of the plurality of storage nodes provides the host with access to a second number of paths that is greater than the first number of paths.

A method comprising:

• associating a logical storage volume with at least one path between a host and at least a given one of a plurality of storage nodes of a distributed storage system, each of the storage nodes storing corresponding portions of the logical storage volume and one or more additional logical storage volumes, a given such logical storage volume being stored in a distributed manner over the storage nodes with different address ranges of the given logical storage volume being stored in different ones of the storage nodes;
• associating a proxy volume with respective sets of one or more paths from the host to each of the plurality of storage nodes of the distributed storage system;
• obtaining an input-output operation directed to the logical storage volume;
• and
• redirecting the input-output operation to the proxy volume over a selected one of the paths associated with the proxy volume;
• wherein the host is configured to expose a first number of paths to at least one application executing on the host, the first number of paths being determined collectively across all of the logical storage volumes accessible to the at least one application;
• wherein associating the proxy volume with the respective sets of one or more paths from the host to each of the plurality of storage nodes provides the host with access to a second number of paths that is greater than the first number of paths;
• and
• wherein the method is performed by at least one processing device comprising a processor coupled to a memory.