Method and system for intra- and inter-cluster communication

A method for inter-cluster communication in a high-performance computer,

• the high-performance computer comprising
• a plurality of clusters interconnected by an IP network, wherein each cluster of the plurality of clusters comprises
• at least one physical Ethernet gateway configured to transmit data between the each cluster and the IP network storing at least one first routing table comprising at least, for each other cluster of the plurality of clusters, an association of a gateway address with a destination IP address comprised in the each cluster comprising the at least one physical Ethernet gateway,
• a plurality of physical computing and/or storage nodes, wherein each node of the plurality of physical computing and/or storage nodes
• being configured to run at least one instance of a high-performance computing and/or storage application,
• comprising at least one network card implementing an Ethernet-based high-performance interconnection protocol and being configured to implement an address resolution protocol,
• wherein the at least one network card stores at least one second routing table comprising at least, for said each other cluster of the plurality of clusters, an association of an address of a gateway of the at least one physical Ethernet gateway of a first cluster with an identifier of the each other cluster accessible from the gateway of the first cluster,
• storing at least one third routing table comprising at least, for said each other cluster of the plurality of clusters, an association of an identifier of an application instance with an identifier of the each cluster comprising the each node running the application instance, with a unique network identifier of the application instance, and with an IP address of the at least one network card of the each node running the application instance,
• at least one physical intra-cluster interconnection switch configured to connect said each node and the at least one physical Ethernet gateway:
• the method comprising:
• receipt, by the at least one network card of a sending node of the plurality of physical computing and/or storage nodes of the first cluster, of a request to send data to at least one destination instance executed by a destination node of the plurality of physical computing and/or storage nodes of a second cluster of the plurality of clusters, the request coming from an instance of a high-performance computing application and comprising an identifier of the at least one destination instance and at least one data item,
• transcription, by the at least one network card of the sending node, of the request that is received into a request from a network library of the Ethernet-based high-performance interconnection protocol, the transcription of the request comprising a transcription of the identifier of the at least one destination instance into a unique identifier in a format of the network library,
• encapsulation, by the at least one network card of the sending node, of the request that is transcribed in an IP packet containing the IP address of a destination network card,
• encapsulation of the IP packet in an Ethernet frame comprising the address of the gateway of the first cluster,
• transmission of the Ethernet frame via the at least one physical intra-cluster interconnection switch and the gateway of the first cluster to the gateway of the second cluster,
• transmission, by the gateway of the second cluster, of the Ethernet frame to the destination network card of the each node running the at least one destination instance,
• decapsulation, by the destination network card, of the Ethernet frame and IP packet to obtain the request comprising the at least one data item,
• transmission, of the at least one data item, by the destination network card, to the at least one destination instance.