Multilayered resource scheduling

A method comprising:

• receiving, by a first task scheduler, a plurality of tasks to be executed on a distributed computing system, each task having a respective set of resource requirements;
• generating, using the first task scheduler, a proxy task comprising a subset of the tasks, the subset of the tasks having a common set of resource requirements;
• scheduling, using second task scheduler, an execution of the proxy task on the distributed computing system;
• receiving, by the first task scheduler, an additional task to be executed on the distributed computing system, the additional task having the common set of resource requirements;
• and
• scheduling an execution of the additional task on the distributed computing system, wherein scheduling the execution of the additional task on the distributed computing system comprises including, by the first task scheduler, the additional task in the proxy task.

A system comprising:

• one or more processors;
• and
• one or more non-transitory computer-readable media including one or more sequences of instructions which, when executed by the one or more processors, causes:
• receiving, by a first task scheduler, a plurality of tasks to be executed on a distributed computing system, each task having a respective set of resource requirements;
• generating, using the first task scheduler, a proxy task comprising a subset of the tasks, the subset of the tasks having a common set of resource requirements;
• scheduling, using second task scheduler, an execution of the proxy task on the distributed computing system;
• receiving, by the first task scheduler, an additional task to be executed on the distributed computing system, the additional task having the common set of resource requirements;
• and
• scheduling an execution of the additional task on the distributed computing system, wherein scheduling the execution of the additional task on the distributed computing system comprises including, by the first task scheduler, the additional task in the proxy task.

One or more non-transitory computer-readable media including one or more sequences of instructions which, when executed by one or more processors, causes:

• receiving, by a first task scheduler, a plurality of tasks to be executed on a distributed computing system, each task having a respective set of resource requirements;
• generating, using the first task scheduler, a proxy task comprising a subset of the tasks, the subset of the tasks having a common set of resource requirements;
• scheduling, using second task scheduler, an execution of the proxy task on the distributed computing system;
• receiving, by the first task scheduler, an additional task to be executed on the distributed computing system, the additional task having the common set of resource requirements;
• and
• scheduling an execution of the additional task on the distributed computing system, wherein scheduling the execution of the additional task on the distributed computing system comprises including, by the first task scheduler, the additional task in the proxy task.