In-network collective operations

At least one non-transitory computer-readable medium comprising instructions stored thereon, that if executed by one or more processors, cause the one or more processors to:

• configure a first network interface device to utilize a reliable transport protocol for communications from at least one worker node of the collective operation to the first network interface device, wherein the utilize a reliable transport protocol for communications from at least one worker node of the collective operation to the first network interface device comprises store packet receipt state for per-packet communications from at least one worker node of the collective operation to the first network interface device and
• configure the first network interface device to utilize a non-reliable transport protocol for communications to a second network interface device that is to perform aggregation of results, wherein the reliable transport protocol comprises a different protocol than that of the non-reliable transport protocol.

A method comprising:

• a first network interface device utilizing a reliable transport protocol for communications from at least one worker node of the collective operation to the first network interface device, wherein the utilize reliable transport protocol for communications from at least one worker node of the collective operation to the first network interface device comprises store packet receipt state for per-packet communications from the at least one worker node of the collective operation to the first network interface device and
• the first network interface device utilizing a non-reliable transport protocol for communications to a second network interface device that is to perform aggregation of results at least one worker node, wherein the reliable transport protocol comprises a different protocol than that of the non-reliable transport protocol.