Dynamic correlated operation management for a distributed computing system

A distributed computing system, comprising:

• storage adapted to store data;
• a plurality of processor nodes including a first processor node and a second processor node, each processor node adapted to access and control the storage;
• and ′
• at least one computer readable storage medium having computer readable program instructions embodied therewith, the program instructions executable by the distributed computing system to cause the distributed computing system to perform operations, the operations comprising:
• performing data processing functions at each of a plurality of processor nodes in a distributed computing system having the plurality of processor nodes and storage coupled to said plurality of processor nodes, said data processing functions including storing data in and retrieving data from said storage, and monitoring other processor nodes in the distributed computing system;
• and
• a first processor node of said plurality of processor nodes:
• maintaining a first synchronization data structure having an entry for each processor node in the distributed computing system, each entry for an associated processor node configured to identify a related task to be performed by the associated processor node in association with a multi-node correlated operation of the distributed computing system in the event of a communication failure with the associated processor node in the distributed computing system;
• performing a first multi-node correlated operation of the distributed computing system;
• detecting a failure to communicate with the second processor node of the distributed computing system;
• performing a first multi-node correlated operation related task in association with said first multi-node correlated operation of the distributed computing system;
• and
• updating the entry associated with the second processor node in the first synchronization data structure to indicate a first multi-node correlated operation related task to be performed by the second processor node.

A computer program product for use with a distributed computing system having storage adapted to store data, and a plurality of processor nodes including a first processor node and a second processor node, each processor node adapted to access and control the storage, the computer program product comprising at least one computer readable storage medium having computer readable program instructions embodied therewith, the program instructions executable by the distributed computing system to cause the distributed computing system to perform operations, the operations comprising:

• performing data processing functions at each of a plurality of processor nodes in a distributed computing system having the plurality of processor nodes and storage coupled to said plurality of processor nodes, said data processing functions including storing data in and retrieving data from said storage, and monitoring other processor nodes in the distributed computing system;
• and
• a first processor node of said plurality of processor nodes:
• maintaining a first synchronization data structure having an entry for each processor node in the distributed computing system, each entry for an associated processor node configured to identify a related task to be performed by the associated processor node in association with a multi-node correlated operation of the distributed computing system in the event of a communication failure with the associated processor node in the distributed computing system;
• performing a first multi-node correlated operation of the distributed computing system;
• detecting a failure to communicate with the second processor node of the distributed computing system;
• performing a first multi-node correlated operation related task in association with said first multi-node correlated operation of the distributed computing system;
• and
• updating the entry associated with the second processor node in the first synchronization data structure to indicate a first multi-node correlated operation related task to be performed by the second processor node.