Controlling operation of a machine by performing reconciliation using a distributed cluster of nodes

A cluster of nodes for performing distributed processing, the cluster of nodes comprising:

• one or more processing devices;
• and
• one or more memory devices having instructions executable by the one or more processing devices for causing the one or more processing devices to:
• obtain parent timestamped data and child timestamped data, wherein the child timestamped data is a child of the parent timestamped data in a hierarchical relationship;
• perform a first distribution operation involving distribute each parent data-point in the parent timestamped data among the cluster of nodes, such that each node in the cluster of nodes is provided with a set of parent data-points that is different from the other nodes in the cluster of nodes;
• perform a second distribution operation involving, for each parent data-point in the parent timestamped data:
• identify a child data-point in the child timestamped data that has the same timestamp as the parent data-point, wherein the parent data-point and the child data-point collectively form a parent-child pair;
• and
• transmit the child data-point to the same node in the cluster of nodes to which the parent data-point was previously transmitted during the first distribution operation, such that the node has the parent-child pair;
• generate a plurality of computer processing-threads on a single processing device of a particular node in the cluster of nodes, such that each computer processing-thread among the plurality of computer processing-threads is assigned to solve a respective reconciliation problem corresponding to a respective parent-child pair stored on the particular node;
• and
• reconcile a difference between the parent data-point and the child data-point in each respective parent-child pair at least in part by executing the plurality of computer processing-threads in parallel on the particular node, to collectively generate a reconciled dataset that is distributed among the cluster of nodes.

A non-transitory computer readable medium comprising program code executable by one or more processing devices of a cluster of nodes in a distributed computing environment for causing the one or more processing devices to:

• obtain parent timestamped data and child timestamped data, wherein the child timestamped data is a child of the parent timestamped data in a hierarchical relationship;
• perform a first distribution operation involving distribute each parent data-point in the parent timestamped data among the cluster of nodes, such that each node in the cluster of nodes is provided with a set of parent data-points that is different from the other nodes in the cluster of nodes;
• perform a second distribution operation involving, for each parent data-point in the parent timestamped data:
• identify a child data-point in the child timestamped data that has the same timestamp as the parent data-point, wherein the parent data-point and the child data-point collectively form a parent-child pair;
• and
• transmit the child data-point to the same node in the cluster of nodes to which the parent data-point was previously transmitted during the first distribution operation, such that the node has the parent-child pair;
• generate a plurality of computer processing-threads on a single processing device of a particular node in the cluster of nodes, such that each computer processing-thread among the plurality of computer processing-threads is assigned to solve a respective reconciliation problem corresponding to a respective parent-child pair stored on the particular node;
• and
• reconcile a difference between the parent data-point and the child data-point in each respective parent-child pair at least in part by executing the plurality of computer processing-threads in parallel on the particular node, to collectively generate a reconciled dataset that is distributed among the cluster of nodes.