Processing system with interspersed processors with multi-layer interconnect

A method performed by a first configurable communication element in a multiprocessor system, wherein the multiprocessor system comprises a plurality of processors, and a plurality of configurable communication elements interspersed among the plurality of processors, wherein each configurable communication element of the plurality of configurable communication elements includes a local memory coupled to a subset of the plurality of processors and a plurality of routing engines, the method comprising:

• receiving one or more messages from a plurality of sources;
• assigning each message of the one or more messages to a given destination of a plurality of destinations dependent upon configuration information;
• and
• forwarding each message of the one or more messages to the destination assigned to the message;
• wherein the plurality of destinations includes:
• a local memory of the first configurable communication element;
• routing engines included in a subset of the plurality of configurable communication elements;
• wherein forwarding each message of one or more messages includes changing the receive status of each assigned destination in response to the completion of sending a message to each assigned destination.

A system, comprising:

• a plurality of processors,
• a plurality of memories interspersed among the plurality of processors, wherein each memory is coupled to a subset of the plurality of processors;
• and
• a plurality of routing engines, wherein each routing engine of the plurality of routing engines is coupled to a respective one of the plurality of memories, a first subset of a plurality of links, and a second subset of the plurality of links;
• wherein each link of the first subset of the plurality of links is coupled to a respective one of a first subset of the plurality of routing engines;
• wherein each link of the second subset of the plurality of links is coupled to a respective one of a second subset of the plurality of routing engines;
• wherein each routing engine of the plurality of routing engines is configured to:
• receive a message, wherein the message includes one or more data words;
• select a destination from a plurality of destinations dependent upon configuration information;
• and
• forward the message to the selected destination;
• wherein to select a destination from the plurality of destinations, each routing engine of the plurality of routing engines is further configured to:
• select the respective one of the plurality of memories;
• and
• select a link from at least one of the first subset of the plurality of links and the second subset of the plurality of links dependent upon the decoded configuration information;
• wherein to forward the message to the selected destination, each routing engine is further configured to change the receive status of each assigned destination in response to the completion of sending a message to the assigned destination.