Method, apparatus, device and storage medium for data aggregation

An apparatus for data aggregation, comprising:

• at least one processor;
• and
• a memory communicatively connected to the at least one processor;
• wherein the memory is stored with instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to:
• acquire original data to be aggregated and divide the original data into at least one first data set;
• determine whether each of the at least one first data set has a corresponding historical aggregation record;
• when there is at least one second data set with a historical aggregation record in the at least one first data set, acquire a historical aggregation result corresponding to each second data set to obtain at least one first aggregation result;
• perform aggregation on each third data set without a historical aggregation record to obtain at least one second aggregation result;
• and
• determine a third aggregation result of the original data according to the at least one first aggregation result and the at least one second aggregation result, and determine a data tag of the original data according to the third aggregation result;
• wherein the at least one processor is further configured to:
• establish a first plan tree corresponding to the original data, the first plan tree comprising at least one first connection node and at least one first aggregation node, one leaf node of the first plan tree constituting one first aggregation node, and data represented by one first aggregation node constituting one first data set;
• wherein the at least one processor is further configured to:
• determine whether a data attribute index of an aggregation record file is completely consistent with that of each of the at least one first aggregation node in a preset file path, wherein the data attribute index comprising a time attribute, a location attribute, a volume attribute, and a format attribute;
• determine that the first aggregation node has a corresponding historical aggregation record when the data attribute index of the aggregation record file is completely consistent with that of each of the at least one first aggregation node, to obtain at least one second aggregation node with a historical aggregation record in the first plan tree, data represented by one second aggregation node constituting one second data set;
• and
• determine that the first aggregation node does not have a corresponding historical aggregation record when the data attribute index of the aggregation record file is not completely consistent with that of each of the at least one first aggregation node.

A non-transitory computer readable storage medium stored with computer instructions, wherein the computer instructions are configured to enable a computer to execute the following steps:

• acquiring original data to be aggregated and dividing the original data into at least one first data set;
• determining whether each of the at least one first data set has a corresponding historical aggregation record;
• when there is at least one second data set with a historical aggregation record in the at least one first data set, acquiring a historical aggregation result corresponding to each second data set to obtain at least one first aggregation result;
• performing aggregation on each third data set without a historical aggregation record to obtain at least one second aggregation result;
• and
• determining a third aggregation result of the original data according to the at least one first aggregation result and the at least one second aggregation result, and determining a data tag of the original data according to the third aggregation result;
• wherein the dividing the original data into at least one first data set comprises:
• establishing a first plan tree corresponding to the original data, the first plan tree comprising at least one first connection node and at least one first aggregation node, one leaf node of the first plan tree constituting one first aggregation node, and data represented by one first aggregation node constituting one first data set;
• wherein the determining whether each of the at least one first data set has a corresponding historical aggregation record comprises:
• determining whether a data attribute index of an aggregation record file is completely consistent with that of each of the at least one first aggregation node in a preset file path, wherein the data attribute index comprising a time attribute, a location attribute, a volume attribute, and a format attribute;
• determining that the first aggregation node has a corresponding historical aggregation record when the data attribute index of the aggregation record file is completely consistent with that of the first aggregation node, to obtain at least one second aggregation node with a historical aggregation record in the first plan tree, data represented by one second aggregation node constituting one second data set;
• and
• determining that the first aggregation node does not have a corresponding historical aggregation record when the data attribute index of the aggregation record file is not completely consistent with that of each of the at least one first aggregation node.