A method of processing data messages in a computing system, comprising:
- receiving messages by a plurality of message queueing nodes of the computing system and storing the messages in message queues provided by the message queueing nodes, where each of the message queueing nodes execute a message queueing service and a message queueing agent, wherein the messages comprise information about events generated by mobile communication devices, and wherein the events comprise information about a blocked call attempt, a dropped call, a signal quality, and a cell site signal strength;
- retrieving messages from the message queues by a plurality of message processing nodes of the computing system, processing the retrieved messages, and delivering these processed messages, where each of the message processing nodes execute a message processing service and a message processing agent;
- adding a message queueing node to the computing system;
- sending a message from a message queueing agent executing on the added message queueing node to a coordinating agent executing on a coordinating node of the computing system, where the message comprises an IP address of the added message queueing node and a node identity number of the added message queueing node;
- updating a coordinating configuration file with the IP address and the node identity number of the added message queueing node by the coordinating agent, where the configuration file is maintained by the coordinating node and the message queueing agents of the message queueing nodes and the message processing agents of the message processing nodes are registered to listen to changes to the coordinating configuration file of the coordinating node;
- notifying the message queueing agents and the message processing agents of the update to the coordinating configuration file based on the message queueing agents and the message processing agents being registered to listen to changes to the coordinating configuration file;
- updating by each message queueing agent a message queueing configuration file associated with its associated message queueing node with the IP address and the node identity number of the added message queueing node;
- updating by each message processing agent a message processing configuration file associated with its associated message processing node with the IP address and the node identity number of the added message queueing node;
- monitoring updates to message queueing configuration files and message processing configuration files by the coordinating agent;
- in response to determining that message queueing configuration files have been updated, restarting the message queueing service on the associated message queueing nodes by the coordinating agent;
- and
- in response to determining that message processing configuration files have been updated, restarting the message processing service on the associated message processing nodes by the coordinating agent.