Implementing updates to source code executing on a plurality of compute nodes

A method of implementing updates to source code executing on a plurality of compute nodes, the method comprising:

• receiving from a source code updater, by a compute node, a broadcast update-notification message indicating there is an update to the source code executing on the plurality of compute nodes;
• in response to receiving the update-notification message, implementing, by the computer node, a distributed barrier on the compute node, the distributed barrier controlling implementation of updates to the source code;
• based on the distributed barrier, halting, by the compute node, execution of the source code at a particular location within the source code;
• based on the distributed barrier, updating in-place, by the compute node, the source code including retaining workpiece data in memory of the compute node, the workpiece data corresponding to the execution of the source code;
• and
• based on completion of the updating of the source code, resuming with the retained workpiece data, by the compute node, execution of the source code at the particular location within the source code where execution was halted.