System and method for improving load balancing in large database management system

A computer readable memory comprises:

• one or more memory sections for storing operational instructions that, when executed by a first intermediate node of a plurality of nodes of a database management system, cause the first intermediate node to:
• receive a message, wherein the first intermediate node is limited to communication with a subset of nodes of the plurality of nodes, wherein the message:
• includes data that is being sent in accordance with a routing path from a source node of the plurality of nodes to a destination node of the plurality of nodes, is a first size, and indicates a next node of the routing path, and wherein the subset of nodes includes the next node;
• and
• process the message by:
• generating a revised message, wherein the revised message includes the data and has a second size;
• determining, based on the message, whether there is at least one additional intermediate node after the next node in the routing path;
• when there is at least one additional intermediate node:
• determining an optimal route for forwarding the revised message to the additional intermediate node via a node of the subset of nodes;
• and
• sending the revised message to the node in accordance with the optimal route;
• maintaining, by the first intermediate node, a tracking table that indicates a total amount of data sent to each node of the subset of nodes during a first time period;
• and
• resetting the total amount of data sent to each node of the subset of nodes to zero based on one or more of a command and an initiation of a second time period.