Data processing method, data querying method, and server device

A server device, comprising a processor, a memory, and a computer program stored in the memory and executed by the processor, wherein the processor is configured to execute the computer program, so as to:

• pull full data regularly in accordance with a predetermined time, partition a Distributed File System (DFS) by date, and store the full data in a corresponding partition of the DFS;
• filter through the full data to obtain incremental data, sort the incremental data, and store the sorted data in a dimension table and an event table of a data warehouse detail layer, the dimension table being associated with the event table through a surrogate key, wherein fields of the dimension table comprises (i) one or more fields associated with user attributes, (ii) one or more fields regarding change times of the user attributes, and (iii) one or more fields about the surrogate key obtained by ranking lifecycles of the user attributes in accordance with the change times of the user attributes;
• and wherein fields of the event table comprises (iv) one or more fields about the surrogate key, (v) one or more fields about event details, and (vi) one or more fields regarding update times of the event details;
• and wherein the surrogate key is used to realize an association between changes of the user attributes and updates of the event details;
• and
• associate the dimension table with the event table to generate a report, generate an aggregate table in accordance with a predetermined aggregation demand, and store the generated aggregate table at a reporting layer.

A non-transitory computer-readable storage medium storing therein a computer program, wherein the computer program is executed by a processor, so as to:

• pull full data regularly in accordance with a predetermined time, partition a Distributed File System (DFS) by date, and store the full data in a corresponding partition of the DFS;
• filter through the full data to obtain incremental data, sort the incremental data, and store the sorted data in a dimension table and an event table of a data warehouse detail layer, the dimension table being associated with the event table through a surrogate key, wherein fields of the dimension table comprises (i) one or more fields associated with user attributes, (ii) one or more fields regarding change times of the user attributes, and (iii) one or more fields about the surrogate key obtained by ranking lifecycles of the user attributes in accordance with the change times of the user attributes;
• and wherein fields of the event table comprises (iv) one or more fields about the surrogate key, (v) one or more fields about event details, and (vi) one or more fields regarding update times of the event details;
• and wherein the surrogate key is used to realize an association between changes of the user attributes and updates of the event details;
• and
• associate the dimension table with the event table to generate a report, generate an aggregate table in accordance with a predetermined aggregation demand, and store the generated aggregate table at a reporting layer.