Live data conversion and migration for distributed data object systems
AssigneeDropbox, Inc.
InventorsAshish Gandhi, Renjish Abraham, Kevin Farrell
Life of this patent
Estimating the term…
Abstract
Techniques are disclosed for converting the data of data objects stored in a DDOS from one data format to another while the system is live and available to process requests for access to the data objects being converted. The conversion techniques do not require taking the DDOS offline. The conversion techniques also do not require locking a data object for the entire conversion of the data object.
Claims20
A computing system comprising:
- a plurality of processors;
- storage media;
- and
- instructions stored in the storage media which, when executed by the plurality of processors, cause the computing system to perform:
- storing a first set of database tables in a target data format based on a second set of database tables in a source data format;
- wherein the first set of database tables and the second set of database tables are stored in a distributed data object system;
- obtaining a first set of one or more signatures for a target database table of the first set of database tables in the target data format;
- for a source database table of the second set of database tables in the source data format:
- acquiring a lock on the source database table,
- obtaining a second set of one or more signatures for the source database table,
- comparing the first set of one or more signatures for the target database table to the second set of one or more signatures for the source database table,
- based on the comparing the first set of one or more signatures to the second set of one or more signatures, determining a set of one or more mismatched database table rows between the target database table and the source database table, and
- copying the set of one or more mismatched database table rows from the source database table in the source data format to the target database table in the target data format.
A computer-implemented method comprising:
- storing a first set of data objects in a target data format based on a second set of data objects in a source data format;
- wherein the first set of data objects and the second set of data objects are stored in a distributed data object system;
- obtaining a first set of one or more signatures for a target data object of the first set of data objects in the target data format;
- for a source data object of the second set of data objects in the source data format:
- acquiring a lock on the source data object,
- obtaining a second set of one or more signatures for the source data object,
- comparing the first set of one or more signatures for the target data object to the second set of one or more signatures for the source data object,
- based on the comparing the first set of one or more signatures to the second set of one or more signatures, determining a set of one or more mismatches between the target data object and the source data object, and
- copying the set of one or more mismatches from the source data object in the source data format to the target data object le in the target data format.
One or more non-transitory storage media storing instructions which, when executed by a computing system having one or more processors, cause the computing system to perform:
- creating a first set of database tables in a target data format from a second set of database tables in a source data format;
- wherein the first set of database tables and the second set of database tables are stored in a distributed data object system;
- obtaining a first set of signatures for a target database table of the first set of database tables in the target data format;
- for a source database table of the second set of database tables in the source data format:
- acquiring a lock on the source database table,
- obtaining a second set of signatures for the source database table,
- comparing the first set of signatures for the target database table to the second set of signatures for the source database table,
- based on the comparing the first set of signatures to the second set of signatures, determining a set of mismatched database table rows between the target database table and the source database table, and
- copying the set of mismatched database table rows from the source database table in the source data format to the target database table in the target data format.
Dependencies are inferred from the claim text.