Task scheduling simulation system

A non-transitory task scheduling simulation system, the system includes a data preprocessing subsystem and a task scheduling subsystem;

• the data preprocessing subsystem is used to filter the input cloud computing log information for abnormal data and extract running time of each task;
• the task scheduling subsystem is used to enqueue or dequeue tasks from the batch task and real-time task running queues of each node, and keep the number and status of tasks currently running in a cluster consistent with an actual production environment, and update the number of CPU cores, and the used and available memory capacity of each node according to resource requirement of each task, to obtain the latest topology of the overall cluster resource utilization;
• wherein the data preprocessing subsystem comprises a data exception and missing processing module, a task information counting module, a resource demand counting module, and a running time counting module;
• the data exception and missing processing module is used to read a native cloud computing cluster operation log to exclude abnormal data;
• the task information counting module is used to count the task information and the number of task instances of each submitted job;
• the resource demand counting module is used to count the total required number of CPU cores and the total required capacity of memory for each job;
• the running time counting module is used to calculate the running time of each task instance, and to counting the estimated running time of each job.