Redis-based database data aggregation and synchronization method

A REDIS-based database data aggregation and synchronization method, for aggregating and synchronizing at least a target database data into an aggregation database, comprising the steps of:

• (S1) using a synchronization program to load the remote connection information of each target database from a configuration file, reading a table structure of the target database, fetching a field and a primary key information of each table, and creating a corresponding table structure in the aggregation database;
• (S2) scanning the data of all tables of the target database by the synchronization program, and then calculating a Key and a Value of all rows row by row;
• (S3) using the Key and Value obtained from the step (S2) as a k-v to be cached and written into the REDIS, splicing rows of all tables of the target database into a standard “INSERT” SQL statement to be executed and written into a corresponding table of the aggregation database;
• (S4) executing the step (S2) to obtain a new Value and a new Key when there is a change of data in the table of the target database, and determining whether or not a key of each row that is same as the new key of a row exists in the REDIS, and if yes, then executing the step (S3) for the row, and if no, then determining whether the new Value of the row is the same as the corresponding Value stored in the REDIS, and if said new Value is different, then overwriting the corresponding Value in the REDIS by the new Value of the row, while splicing the row into a standard “UPDATE” SQL statement to update the row in the corresponding table of the aggregation database;
• (S5) performing a difference set calculation for a primary key set of all tables of the target database data after the change occurs and the primary key set of the table corresponding to the aggregation database obtained in the step (S4), and if an element exists in the difference set, generating a standard “DELETE” SQL statement in the corresponding table of the aggregation database to delete the data in the aggregation database corresponding to the already deleted data of the target database.