Parallel program control system and method

A method of operating a controller to control a plurality of parallel programs operating in an n-dimensional hierarchical iteration space over an n-dimensional data space, comprising:

• decoding memory location references to regions of the n-dimensional data space from indices in the plurality of parallel programs;
• sequencing regions of the n-dimensional hierarchical iteration space of the plurality of parallel programs to honour a data requirement of at least a first of the plurality of parallel programs having a data dependency on at least a second of the plurality of parallel programs;
• and
• decoding memory location references of a partially specified tensor to determine dimensions in memory of sufficient size to accommodate the partially specified tensor and at least one affine transform of the partially specified tensor.

A computer program product stored in a non-transitory computer readable medium and comprising computer readable program code to:

• decode memory location references to regions of an n-dimensional data space from indices in a plurality of parallel programs;
• and
• sequence regions of an n-dimensional hierarchical iteration space of the plurality of parallel programs to honour a data requirement of at least a first of the plurality of parallel programs having a data dependency on at least a second of the plurality of parallel programs;
• further comprising decoding memory location references of a partially specified tensor to determine dimensions in memory of sufficient size to accommodate the partially specified tensor and at least one affine transform of the partially specified tensor.