Application load adaptive multi-stage parallel data processing architecture

A system including processors and implemented on hardware logic and/or software logic executing on the processors, the system comprising a plurality of subsystems for load-adaptive resource management of a pool of processing resources on behalf of a plurality of applications, the plurality of subsystems comprising:

• a first subsystem configured to allocate a plurality of processing units of the pool of processing resources to the plurality of applications based at least in part on i) respective expressions of demand for the pool of processing resources by the plurality of applications, and ii) respective entitlements of one or more applications of the plurality of applications to computing capacity of the pool of processing resources;
• a second subsystem configured to, for each application of the plurality of applications, select a set of highest priority instances of one or more instances of the respective application corresponding to processing units allocated by the first subsystem for an upcoming allocation period, wherein the set of highest priority instances are selected based at least in part on a relative readiness for processing among the one or more instances of the respective application;
• and
• a third subsystem configured to assign the set of the highest priority instances of each of the plurality of applications for execution during the upcoming allocation period on a respective one or more processing units of the plurality of processing units based at least in part on the allocation of the plurality of processing units among the plurality of applications by the first subsystem;
• wherein the allocating is repeated periodically such that allocations of the plurality of processing units vary over time based at least in part on changes in expressions of demand for the pool of processing resources associated with each of the plurality of applications, wherein
• assigning the set of highest priority instances of each of the plurality of applications comprises preserving core assignments to instances selected for execution on consecutive core allocation periods;
• the system being further configured to periodically adjust allocations of the plurality of processing units of the pool of processing resources over time, wherein such adjusting is followed by accordingly carrying out the selecting and the assigning.

A method for load-adaptive resource management of a parallel processing system on behalf of application programs, the method comprising:

• a) identifying, by a control system, a respective expression of demand for the computing capacity of the parallel processing system associated with each program of a plurality of application programs;
• b) identifying, by the control system, a respective entitlement for computing capacity of the parallel processing system associated with one or more programs of the plurality of application programs;
• c) allocating, by the control system, a plurality of units of the computing capacity of the parallel processing system to at least a subset of the plurality of application programs, wherein
• the allocating is based at least in part on i) the expressions of demand of each of the subset of application programs, and ii) the entitlements of the one or more programs of the subset of application programs;
• d) for each program of the subset of application programs,
• assessing, by the control system, a relative readiness for execution among one or more instances of the respective program, and
• selecting, by the control system, a set of highest priority instances of the one or more instances of the respective program for execution on the parallel processing system according to i) a number of units of the plurality of units of computing capacity allocated to the respective application program, and ii) the relative readiness for execution among the one or more instances of the respective program;
• e) assigning the set of the highest priority instances of each of the at least the subset of the plurality of application programs for execution on a respective one or more units of the plurality of units of computing capacity based at least in part on the allocations of the units of computing capacity among the plurality of application programs;
• and
• f) periodically repeating steps a) through e) to modify allocations over time based at least in part on changes in the respective expressions of demand for each of the plurality of application programs;
• wherein assigning the set of highest priority instances of each of the subset of the plurality of application programs comprises preserving core assignments to instances selected for execution on consecutive repetitions of steps a) through e).