Bandwidth efficient access to persistent storage in a distributed storage system

A method comprising:

• responsive to receipt of an input-output operation by a first storage node of a distributed storage system where processing of the input-output operation requires access to at least one persistent storage device remote from the first storage node but local to a second storage node of the distributed storage system:
• sending at least one request from the first storage node to the second storage node identifying data associated with the operation;
• determining a buffer of the second storage node that is allocated for use by the second storage node for temporary storage of the data;
• and
• utilizing the buffer for at least one of (i) providing the data to the second storage node to allow the second storage node to write the data to the persistent storage device, and (ii) obtaining the data from the second storage node after the second storage node has read the data from the persistent storage device;
• wherein sending at least one request from the first storage node to the second storage node identifying data associated with the operation comprises sending a write request identifying write data to be written by the second storage node to the persistent storage device local to the second storage node;
• wherein the first storage node writes the write data into the buffer using a remote direct memory access connection between the first storage node and the second storage node;
• wherein the second storage node writes the data to the persistent storage device using a local network connection that has a substantially higher bandwidth than that of a remote direct memory access connection between the first storage node and the persistent storage device;
• and
• wherein the method is performed by at least one processing device comprising at least a portion of the distributed storage system, said at least a portion comprising a processor coupled to a memory.

A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device comprising at least a portion of a distributed storage system, the distributed storage system comprising at least first and second storage nodes, causes said at least one processing device:

• responsive to receipt of an input-output operation by the first storage node of the distributed storage system where processing of the input-output operation requires access to at least one persistent storage device remote from the first storage node but local to the second storage node of the distributed storage system:
• to send at least one request from the first storage node to the second storage node identifying data associated with the operation;
• to determine a buffer of the second storage node that is allocated for use by the second storage node for temporary storage of the data;
• and
• to utilize the buffer for at least one of (i) providing the data to the second storage node to allow the second storage node to write the data to the persistent storage device, and (ii) obtaining the data from the second storage node after the second storage node has read the data from the persistent storage device;
• wherein sending at least one request from the first storage node to the second storage node identifying data associated with the operation comprises sending a write request identifying write data to be written by the second storage node to the persistent storage device local to the second storage node;
• wherein the first storage node writes the write data into the buffer using a remote direct memory access connection between the first storage node and the second storage node;
• and
• wherein the second storage node writes the data to the persistent storage device using a local network connection that has a substantially higher bandwidth than that of a remote direct memory access connection between the first storage node and the persistent storage device.