Distributed monitoring in clusters with self-healing

A system comprising:

• a cluster of nodes including at least a first node and a second node, wherein each node in the cluster includes a monitoring agent and a registry for recording node status values for each node in the cluster;
• wherein a first monitoring agent of the first node is configured to:
• perform at least one self-monitoring check for the first node;
• in response to receiving a successful status for the at least one self-monitoring check, update a first registry in the first node with the successful status;
• in response to receiving an unsuccessful status for the at least one self-monitoring check, perform at least one first corrective action on the first node and update the first registry in the first node with a result of the at least one corrective action;
• and
• broadcast the first registry in the first node to each of the other nodes in the cluster as an updated registry;
• and
• wherein a second monitoring agent of the second node is configured to:
• receive the updated registry;
• determine an error condition for the first node in the updated registry;
• and
• perform at least one second corrective action on the first node.