Programmatically controlled data multicasting across multiple compute engines

A processing system comprising:

• a plurality of processors;
• a distributed shared memory comprising a plurality of distributed shared memory areas, wherein the plurality of processors are each associated with a respective distributed shared memory area;
• and
• packet distribution circuitry configured to, in response to receiving a memory access request from a first processor of the plurality of processors, storing metadata from the memory access request in a tracking circuitry and generating a modified memory access request, and, in response to receiving response data in response to the memory access request, forming a multicast response packet including the metadata and transmitting the multicast response packet to at least second processors of said plurality of processors.