Mpi collective operations

A node for performing a message passing interface (MPI) collective operation on data in a network, wherein the network comprises a plurality of interconnected nodes that includes the node, the node comprising one or more processors a processor configured to:

• receive, at the node of the plurality of interconnected nodes, MPI collective operation information identifying the MPI collective operation to be performed, and a graph of the network;
• determine a number of algorithmic steps of the MPI collective operation based on the MPI collective operation and the graph of the network;
• determine an initialisation process for the algorithmic steps;
• determine a finalisation process for the algorithmic steps;
• determine, for each of the algorithmic steps:
• a subset of nodes of the plurality of interconnected nodes for the node to communicate with;
• and
• one or more portions of data for the node to send to and receive from the nodes within the subset of nodes;
• and
• initialize the MPI collective operation based on the determined subset, initialisation process and finalisation process, and the one or more portions of data.

Computer-readable media comprising instructions executable by one or more processors to cause the one or more processors to:

• receive, at a node of a plurality of interconnected nodes in a network, message passing interface (MPI) collective operation information identifying the MPI collective operation to be performed in the network, and a graph of the network, wherein;
• determine a number of algorithmic steps of the MPI collective operation based on the MPI collective operation and the graph of the network;
• determine an initialisation process for the algorithmic steps;
• determine a finalisation process for the algorithmic steps;
• determine, for each of the algorithmic steps:
• a subset of nodes of the plurality of interconnected nodes for the node to communicate with;
• and
• one or more portions of data for the node to send to and receive from the nodes within the subset of nodes;
• and
• initialize the MPI collective operation based on the determined subset, initialisation process and finalisation process, and the one or more portions of data.