Reconfigurable computing pods using optical networks

A system, comprising:

• a data processing apparatus;
• and
• a computer storage medium encoded with a computer program, the program comprising data processing apparatus instructions that when executed by the data processing apparatus cause the data processing apparatus to perform operations comprising:
• identifying a target arrangement of compute nodes for executing a computing workload;
• and
• generating a workload cluster of compute nodes having an arrangement that matches the target arrangement of compute nodes, comprising:
• selecting, from a set of n-dimensional building blocks that each include an n-dimensional arrangement of compute nodes, a subset of the building blocks for the computing workload, wherein n is greater than or equal to two, wherein each building block in the set of building blocks is connected to an optical network that includes one or more optical circuit switches for each of the n-dimensions, and wherein each building block includes a plurality of segments of compute nodes along one or more of the n-dimensions;
• and
• configuring, for each dimension of the n-dimensions, the one or more optical circuit switches for the dimension by updating respective routing data for the one or more optical circuit switches for the dimension such that each compute node of the subset of building blocks along the dimension communicate, through the one or more optical circuit switches for the dimension, with each other compute node of the subset of building blocks along the dimension;
• and
• causing the compute nodes of the workload cluster to execute the computing workload.

A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by one or more data processing apparatus cause the one or more data processing apparatus to perform operations comprising:

• identifying a target arrangement of compute nodes for executing a computing workload;
• and
• generating a workload cluster of compute nodes having an arrangement that matches the target arrangement of compute nodes, comprising:
• selecting, from a set of n-dimensional building blocks that each include an n-dimensional arrangement of compute nodes, a subset of the building blocks for the computing workload, wherein n is greater than or equal to two, wherein each building block in the set of building blocks is connected to an optical network that includes one or more optical circuit switches for each of the n-dimensions, and wherein each building block includes a plurality of segments of compute nodes along one or more of the n-dimensions;
• and
• configuring, for each dimension of the n-dimensions, the one or more optical circuit switches for the dimension by updating respective routing data for the one or more optical circuit switches for the dimension such that each compute node of the subset of building blocks along the dimension communicate through the one or more optical circuit switches for the dimension, with each other compute node of the subset of building blocks along the dimension;
• and
• causing the compute nodes of the workload cluster to execute the computing workload.