System and methods for live data migration
AssigneePalantir Technologies Inc.
InventorsJoseph Ellis, Mark Elliot, Robert Fink, Sandor Van Wassenhove
Life of this patent
Estimating the term…
Abstract
Systems and methods are provided for data migration. The system may comprise one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the system to migrate at least one first table of a first database schema to at least one second table of a second database schema, determine a query for modifying the first table during the migration, modify the second table based at least in part on the query, and update a mutation table to describe the modification, wherein the mutation table at least describes the modification.
Claims18
A computing system for live data migration, the computing system comprising:
- one or more processors;
- and
- memory storing instructions that, when executed by the one or more processors, cause the computing system to perform:
- receiving a query for accessing a first field;
- retrieving data from a first data source responsive to the query, the data being related to or including the first field;
- during the retrieving of the data, migrating data from a second data source to the first data source;
- generating a tracking data structure that records any modifications occurring in the first data source during the migration of the data to the first data source;
- updating the retrieved data based on the tracking data structure;
- and
- returning any first field data within the first field in response to:
- receiving the query, and
- the first field being unmodified during the migrating of the data from the second data source to the first data source.
A computer-implemented method, the method being implemented by a computing system including one or more processors and storage media storing machine-readable instructions, the method comprising:
- receiving a query for accessing a first field;
- retrieving data from a first data source responsive to the query, the data being related to or including the first field;
- during the retrieving of the data, migrating data from a second data source to the first data source;
- generating a tracking data structure that records any modifications occurring in the first data source during the migration of the data to the first data source;
- updating the retrieved data based on the tracking data structure;
- and
- returning any first field data within the first field in response to:
- receiving the query, and
- the first field being unmodified during the migrating of the data from the second data source to the first data source.
A non-transitory computer readable medium comprising instructions that, when executed, cause one or more processors to perform:
- receiving a query for accessing a first field;
- retrieving data from a first data source responsive to the query, the data being related to or including the first field;
- during the retrieving of the data, migrating data from a second data source to the first data source;
- generating a tracking data structure that records any modifications occurring in the first data source during the migration of the data to the first data source;
- updating the retrieved data based on the tracking data structure;
- and
- returning any first field data within the first field in response to:
- receiving the query, and
- the first field being unmodified during the migrating of the data from the second data source to the first data source.
Dependencies are inferred from the claim text.