System and methods for live data migration
AssigneePalantir Technologies Inc.
InventorsJoseph Ellis, Mark Elliot, Robert Fink, Sandor Van Wassenhove
Life of this patent
Estimating the term…
Abstract
Systems and methods are provided for data migration. The system may comprise one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the system to migrate at least one first table of a first database schema to at least one second table of a second database schema, determine a query for modifying the first table during the migration, modify the second table based at least in part on the query, and update a mutation table to describe the modification, wherein the mutation table at least describes the modification.
Claims13
A system for live data migration, the system comprising:
- one or more processors;
- and
- memory storing instructions that, when executed by the one or more processors, cause the system to perform:
- migrating at least one first table of a first database schema to at least one second table of a second database schema, the at least one first table storing live data;
- determining a query for modifying the at least one first table during the migration;
- modifying the at least one second table based at least in part on the query;
- updating a mutation table to describe the modification, wherein the mutation table tracks one or more changes to the at least one first table;
- determining at least one field to be migrated from the at least one first table to the at least one second table;
- determining that no write operations have been performed to a row corresponding to the at least one field during the migration, the determining based at least in part on the mutation table;
- and
- migrating the at least one field from the at least one first table to the at least one second table, the migrating causing data corresponding to the at least one field from the first table to be populated in one or more fields of the second table based at least in part on a respective schema of the second table.
A computer-implemented method, the method being implemented by a computing system including one or more processors and storage media storing machine-readable instructions, the method comprising:
- migrating at least one first table of a first database schema to at least one second table of a second database schema, the at least one first table storing live data;
- determining a query for modifying the at least one first table during the migration;
- modifying the at least one second table based at least in part on the query;
- updating a mutation table to describe the modification, wherein the mutation table tracks one or more changes to the at least one first table;
- determining at least one field to be migrated from the at least one first table to the at least one second table;
- determining that no write operations have been performed to a row corresponding to the at least one field during the migration, the determining based at least in part on the mutation table;
- and
- migrating the at least one field from the at least one first table to the at least one second table, the migrating causing data corresponding to the at least one field from the first table to be populated in one or more fields of the second table based at least in part on a respective schema of the second table.
A non-transitory computer readable medium comprising instructions that, when executed, cause one or more processors to perform:
- migrating at least one first table of a first database schema to at least one second table of a second database schema, the at least one first table storing live data;
- determining a query for modifying the at least one first table during the migration;
- modifying the at least one second table based at least in part on the query;
- updating a mutation table to describe the modification, wherein the mutation table tracks one or more changes to the at least one first table;
- determining at least one field to be migrated from the at least one first table to the at least one second table;
- determining that no write operations have been performed to a row corresponding to the at least one field during the migration, the determining based at least in part on the mutation table;
- and
- migrating the at least one field from the at least one first table to the at least one second table, the migrating causing data corresponding to the at least one field from the first table to be populated in one or more fields of the second table based at least in part on a respective schema of the second table.
Dependencies are inferred from the claim text.