Cross-site high-availability distributed cloud storage system to provide multiple virtual channels between storage nodes

A distributed storage system comprising:

• a first storage node configured to:
• generate a plurality of interconnect (IC) channels for remote direct memory access (RDMA) streams;
• map each IC channel to a group of a plurality of transport layer sessions using an IC transport layer of the first storage node;
• split data traffic of each IC channel into a plurality of packets distributed across the group of the plurality of transport layer sessions;
• assign a unique transaction identification (ID) to each IC request and a different data offset to each packet;
• and
• a second storage node peered with the first storage node, the second storage node configured to:
• receive, with a plurality of receive queues of a device driver of the second storage node, the plurality of packets from the plurality of transport layer sessions;
• map each transport layer session to a respective receive queue of the plurality of receive queues;
• order IC requests into a per IC channel queue based on the unique transaction IDs;
• and
• order packets within the per IC channel queue based on the data offsets.

A method comprising:

• determining, with an interconnect (IC) layer of a first storage node of a distributed storage system, a first channel count for the first storage node based on at least one of:
• processing resource capabilities, memory capability, network bandwidth, or performance requirements of the first storage node;
• negotiating the first channel count with a second channel count determined by a peered second storage node to establish a negotiated channel count;
• establishing a plurality of IC channels between the first storage node and the peered second storage node based on the negotiated channel count;
• and
• mapping each IC channel of the plurality of IC channels to one or more transport layer sessions for data transfers between the first storage node and the peered second storage node.