Distributed hierarchical scheduler

A non-transitory computer-readable storage medium containing a program which, when executed by one or more processors, performs operations for assigning a resource consumer to one of a plurality of resource buckets, the operations comprising:

• receiving a request to assign the resource consumer;
• propagating the request to assign the resource consumer down a hierarchy of schedulers to one or more leaf schedulers, wherein each of the one or more leaf schedulers responds to the request by propagating up the hierarchy of schedulers a respective score indicating available resources in a corresponding resource bucket, and wherein parent schedulers in the hierarchy of schedulers each compare received scores propagated up the hierarchy of schedulers and further propagate up one of the received scores based on the comparison;
• and
• assigning the resource consumer to one of the resource buckets based on a comparison of scores that are propagated completely up the hierarchy.

A computer-implemented method of assigning a resource consumer to one of a plurality of resource buckets, comprising:

• monitoring available resources on one of the resource buckets;
• receiving a request to assign the resource consumer, wherein the request has been propagated down a hierarchy of schedulers from a root scheduler;
• and
• propagating up the hierarchy of schedulers a score indicating available resources in the one of the resource buckets,
• wherein parent schedulers in the hierarchy of schedulers each compare received scores that have been propagated up the hierarchy of schedulers and further propagate up one of the received scores based on the comparison, and
• wherein the resource consumer is assigned to one of the resource buckets by the root scheduler based on a comparison of scores that are propagated completely up the hierarchy.