Dividing and parallel processing record sets using a plurality of sub-tasks executing across different computers

A data processing method including:

• a division step in which a plurality of tasks in each of which data processing, including a parallel processing that can be performed by a plurality of computers in parallel and a serial processing that is a post-processing of the parallel processing and performed by one computer, is performed to a record set that is a set of a plurality of records are received, and the parallel processing that is a preprocessing of the serial processing to which an expected processing time thereof is greater than that of the serial processing included in another task is divided into a plurality of sub tasks by subdividing the record set that is a processing target of the parallel processing;
• and
• an assignment step in which the plurality of the sub tasks are assigned to the plurality of the computers so that the plurality of the sub tasks are performed before a task other than the task including the parallel processing is performed,
• wherein when an expected processing time of a task in the plurality of tasks is longer than an expected processing time of the serial processing with the longest processing time, the parallel processing included in the task is then divided.

A non-transitory computer readable medium storing a program that causes a computer serving as an data processing system to execute a process to:

• perform a division process in which a plurality of tasks in each of which a data processing, including a parallel processing that can be performed by a plurality of computers in parallel and a serial processing that is a post-processing of the parallel processing and performed by one computer, is performed to a record set that is a set of a plurality of records are received, and the parallel processing that is a preprocessing of the serial processing to which an expected processing time thereof is greater than that of the serial processing included in another task is divided into a plurality of sub tasks by subdividing the record set that is a processing target of the parallel processing;
• and
• an assignment process in which the plurality of the sub tasks are assigned to the plurality of the computers so that the plurality of the sub tasks are performed before a task other than the task including the parallel processing is performed,
• wherein when an expected processing time of a task in the plurality of tasks is longer than an expected processing time of the serial processing with the longest processing time, the parallel processing included in the task is then divided.