Execution job compute unit composition in computing clusters

An apparatus, comprising:

• one or more non-transitory computer readable storage media;
• program instructions stored on the one or more non-transitory computer readable storage media that, based on being executed by a processing system, direct the processing system to at least:
• determine resource allocations for handling execution jobs directed to a computing cluster by at least subdividing the execution jobs into work units each corresponding to portion of a data set to be processed;
• form compute units to handle the work units of the execution jobs, the compute units comprising sets of disaggregated physical computing components that each include at least a central processing unit and a co-processing unit and are selected from among a pool of computing components individually coupled to at least a communication fabric that logically isolates the sets from each other responsive to formation of the compute units;
• deploy individual work units such that a corresponding co-processing unit of each of the compute units processes a data set of a corresponding work unit;
• and
• responsive to completions of the work units of the execution jobs, decompose the computing components of the compute units back into the pool of computing components.

A control system, comprising:

• a cluster management element configured to determine resource allocations for handling execution jobs directed to a computing cluster by at least subdividing the execution jobs into work units each corresponding to portion of a data set to be processed;
• a communication fabric interface configured to control a communication fabric to form compute units to handle the work units of the execution jobs, the compute units comprising sets of disaggregated physical computing components that each include at least a central processing unit and a co-processing unit and are selected from among a pool of computing components individually coupled to at least the communication fabric that logically isolates the sets from each other responsive to formation of the compute units;
• the cluster management element configured to deploy individual work units such that a corresponding co-processing unit of each of the compute units processes a data set of a corresponding work unit;
• and
• the communication fabric interface configured to control the communication fabric to decompose the computing components of the compute units back into the pool of computing components responsive to completions of the work units of the execution jobs.