Job Scheduling Method, Device, and Distributed System
AssigneeAlibaba Group Holding Limited
InventorHua Cai
Life of this patent
Estimating the term…
Abstract
A job scheduling method including notifying, by a first control node scheduling a first task, a second control node scheduling a second task to obtain execution data generated by at least one task instance of the first task when the at least one task instance of the first task completes execution; obtaining, by the second control node, the execution data generated by the at least one task instance of the first task and assigning the execution data to each task instance of the second task; and scheduling, by the second control node, an execution of at least one task instance of the second task and processing the execution data. The techniques of the present disclosure improve scheduling efficiency and resource utilization rate.
Claims20
A system comprising:
- a central node that assigns a plurality of tasks of a job to a plurality of control nodes respectively, the plurality of tasks including a first task and a second task, the plurality of control nodes including a first control node and a second control node, the first task being an execution task in the job, the second task being another task dependent on the first task in the job, a respective control node of the plurality of control nodes scheduling to execute a respective task assigned to the respective control node, a plurality of computing nodes being connected to the respective control node, a respective computing node of the plurality of computing nodes executing a respective task instance assigned by the respective control node;
- a first control node scheduling a first task that notifies a second control node scheduling a second task to obtain execution data generated by at least one task instance of the first task when the at least one task instance of the first task completes execution;
- and
- the second control node that obtains the execution data generated by the at least one task instance of the first task and assigns the execution data to each task instance of the second task, and schedules to execute at least one task instance of the second task to process the execution data.
A method comprising:
- obtaining, by a second control node scheduling a second task in a job, execution data generated by at least one task instance of a first task, the first task being scheduled by a first control node, the first task being an execution task in the job, the second task being another task dependent on the first task in the job;
- assigning the execution data to each task instance of the second task;
- and
- scheduling to execute at least one task instance of the second task to process the execution data.
A method comprising:
- notifying, by a first control node scheduling a first task of a job, a second control node scheduling a second task of the job to obtain execution data generated by at least one task instance of the first task when the at least one task instance of the first task completes execution, the first task being an execution task in the job, the second task being another task dependent on the first task in the job.
Dependencies are inferred from the claim text.