Scalable in-network computation for massively-parallel shared-memory processors

A network device in communication with a plurality of endpoints via a network, the network device comprising:

• a number of ports connected to the network;
• memory storing a table;
• and
• logic configured to:
• receive a push request associated with a collective communication primitive, allocate an entry in the table,
• combine a payload in the push request with an intermediate result stored in the entry to produce a combined intermediate result that is stored in the entry,
• determine whether additional push requests associated with the collective communication primitive are expected to be received by the network device, and
• if additional push requests are expected to be received, then wait to receive one or more additional push requests associated with the collective communication primitive, wherein a payload associated with each of the one or more additional push requests is combined with the combined intermediate result stored in the entry, or
• if additional push requests are not expected to be received, then generate a push response that is forwarded to at least one endpoint of the plurality of endpoints that participates in a computation, wherein a payload of the push response includes the combined intermediate result.

A non-transitory computer-readable media storing computer instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

• receiving, at a network device in communication with a plurality of endpoints via a network, a push request associated with a collective communication primitive;
• allocating an entry in a table maintained by the network device;
• combining a payload in the push request with an intermediate result stored in the entry to produce a combined intermediate result that is stored in the entry;
• determining whether additional push requests associated with the collective communication primitive are expected to be received by the network device, wherein a number of expected push requests associated with the collective communication primitive is identified by querying a multicast region table based on a network address specified in the push request;
• and
• if additional push requests are expected to be received, then waiting to receive one or more additional push requests associated with the collective communication primitive, wherein a payload associated with each of the one or more additional push requests is combined with the combined intermediate result stored in the entry, or
• if additional push requests are not expected to be received, then generating a push response that is forwarded to at least one endpoint of the plurality of endpoints that participates in the computation, wherein a payload of the push response includes the combined intermediate result.

A method performed by a network device which is in communication with a plurality of endpoints via a network, the method comprising:

• receiving a push request associated with a collective communication primitive;
• maintaining a table;
• allocating an entry in the table;
• storing an intermediate result in the entry;
• combining a payload in the push request with the intermediate result to produce a combined intermediate result;
• storing the combined intermediate result in the entry;
• determining whether additional push requests associated with the collective communication primitive are expected to be received by the network device;
• and
• if additional push requests are expected to be received, then waiting to receive one or more additional push requests associated with the collective communication primitive, wherein a payload associated with each of the one or more additional push requests is combined with the combined intermediate result stored in the entry,
• if additional push requests are not expected to be received, then generating a push response and forwarding the push response to at least one endpoint of the plurality of endpoints that participates in a computation, wherein a payload of the push response includes the combined intermediate result.