Task grouping in a distributed processing framework system and methods for implementing the same

A method for distributing an execution of a plurality of tasks within a tasklist by a system controller, the plurality of tasks configured to be processed by a plurality of processing resources in a distributed processing framework (DPF) system, the method comprising:

• loading the tasklist, the tasklist having a main task and a subtask;
• allocating a processing resource to execute each task within the tasklist;
• deploying the main task for execution;
• deploying the subtask to the processing resource upon receiving a special request for the subtask from the main task;
• and
• enabling communication between the main task and the subtask, the communication configured to provide the main task with a result of a subtask execution.

A method for distributing an execution of a plurality of tasks by a system controller, the plurality of tasks configured to be processed by a plurality of processing resources in a distributed processing framework (DPF) system, the method comprising:

• loading a plurality of tasks to be executed;
• allocating a processing resource to execute each of the plurality of tasks;
• deploying each task to a respective processing resource substantially at the same time;
• receiving a result task from each processing resource upon a conclusion of each task;
• and
• releasing the plurality of processing resources upon receiving a result of an execution from each of the plurality of processing resources.

A method for distributing an execution of a plurality of tasks by a system controller, the plurality of tasks configured to be processed by a plurality of processing resources in a distributed processing framework (DPF) system, the method comprising:

• loading a plurality of tasks to be executed;
• allocating a processing resource to execute each of the plurality of tasks;
• deploying a first task of the plurality of tasks to a first processing resource of the plurality of processing resources;
• deploying a second task of the plurality of tasks to a second processing resource of the plurality of processing resources upon receiving a result of an execution of the first task;
• releasing the plurality of processing resources upon receiving a result of an execution for each of the plurality of tasks.