Database synchronization with rateless invertible bloom lookup tables

A non-transitory machine-readable medium having program code stored thereon, the program code comprising instructions to:

• communicate a synchronization request to a source database and a target database, wherein the synchronization request comprises a request for synchronizing a source dataset at the source database with a target dataset at the target database;
• based on receiving the synchronization request at the source database and receiving the synchronization request at the target database, generate, at the source database, the first set of coded symbols and generate, at the target database, the second set of coded symbols;
• based on receiving a first set of coded symbols and a second set of coded symbols from the source database and the target database, respectively, decode the first set of coded symbols and the second set of coded symbols to obtain one or more decoded symbols, wherein the first set of coded symbols comprises encodings of a first plurality of source symbols for the source dataset and the second set of coded symbols comprises encodings of a second plurality of source symbols for the target dataset;
• and
• determine whether the source dataset and the target dataset are synchronized based on the indications of whether each of the one or more decoded symbols belongs to the first plurality of source symbols or the second plurality of source symbols.

An apparatus comprising:

• a processor;
• and
• a machine-readable medium having instructions stored thereon that are executable by the processor to cause the apparatus to remotely synchronize datasets across databases with low communications overhead, wherein the instructions to remotely synchronize datasets across databases comprise instructions executable by the processor to cause the apparatus to,
• communicate a synchronization request to a source database and a target database, wherein the synchronization request comprises a request for synchronizing a source dataset at the source database with a target dataset at the target database;
• based on receiving a first set of coded symbols and a second set of coded symbols from the source database and the target database, respectively, in response to the synchronization request, decode the first set of coded symbols and the second set of coded symbols to obtain one or more decoded symbols, wherein the first set of coded symbols comprises encodings of a first plurality of source symbols for the source dataset and the second set of coded symbols comprises encodings of a second plurality of source symbols for the target dataset;
• determine whether the source dataset and the target dataset are synchronized based on indications membership of each of the one or more decoded symbols belongs to the first plurality of source symbols or second plurality of source symbols;
• and
• based on determining that the source dataset and the target dataset are not synchronized, update the target dataset to be synchronized with the source dataset based, at least in part, on the indications of membership of the one or more decoded symbols.