Batch processing tracking

A method for batch processing in a distributed information technology system comprising a plurality of interconnected processing nodes and a controller communicatively coupled to the processing nodes, the method comprising, at the controller:

• providing an end-of-batch indication for a batch of initial data to be processed by at least one first processing node of the plurality of processing nodes;
• receiving, from each of the at least one first processing node, a completion indication indicating that the at least one first processing node has completed processing the batch of initial data resulting in one or more batches of intermediate data;
• providing an end-of-batch indication for each of the one or more batches of intermediate data to be processed by one or more second processing nodes of the plurality of processing nodes;
• receiving, from each of the at least one second processing node, a completion indication indicating that the at least one second processing node has completed processing the batch of intermediate data resulting in a batch of final data;
• generating a control signal indicating that the batch processing has been completely processed.