Selective table replication to enable stream replication
AssigneeSnowflake Inc.
InventorsIstvan Cseri, Tyler Jones, Daniel E. Sotolongo, Boyuan Zhang
Life of this patent
Estimating the term…
Abstract
Techniques described herein can enable stream replication. A first deployment can store a table including one or more streams. The techniques described herein can be used to replicate the table at a second deployment while replicating the one or more streams associated with the table. Select prior table versions and partitions in the table are copied to the second deployment to enable stream replication.
Claims21
A method comprising:
- generating, by a first deployment in a network-based database system, an inventory including status information of a replicated copy of a table in response to a refresh request, the table being stored in a second deployment and the table including a stream tracking change data capture information related to the table;
- transmitting, by the first deployment, the inventory to the second deployment;
- receiving, by the first deployment, an update snapshot from the second deployment, the update snapshot including information indicating changes on the table stored at the second deployment since a last refresh and including information regarding at least one select table version and at least one select partition for enabling replication of the stream, the at least one select partition being deleted in the table prior to current table version;
- and
- generating, by the first deployment, a refreshed replicated copy of the table at the second deployment based on the update snapshot, the refreshed replicated copy including a replicated copy of the stream using replicated copies of the at least one select table version and the at least one select partition, the stream being append-only stream recording row inserts into the table and not recording update and delete operations on the table.
A machine-storage medium embodying instructions that, when executed by a machine, cause the machine to perform operations comprising:
- generating, by a first deployment in a network-based database system, an inventory including status information of a replicated copy of a table in response to a refresh request, the table being stored in a second deployment and the table including a stream tracking change data capture information related to the table;
- transmitting, by the first deployment, the inventory to the second deployment;
- receiving, by the first deployment, an update snapshot from the second deployment, the update snapshot including information indicating changes on the table stored at the second deployment since a last refresh and including information regarding at least one select table version and at least one select partition for enabling replication of the stream, the at least one select partition being deleted in the table prior to current table version;
- and
- generating, by the first deployment, a refreshed replicated copy of the table at the second deployment based on the update snapshot, the refreshed replicated copy including a replicated copy of the stream using replicated copies of the at least one select table version and the at least one select partition, the stream being append-only stream recording row inserts into the table and not recording update and delete operations on the table.
A system comprising:
- at least one hardware processor;
- and
- at least one memory storing instructions that, when executed by the at least one hardware processor, cause the at least one hardware processor to perform operations comprising:
- generating, by a first deployment in a network-based database system, an inventory including status information of a replicated copy of a table in response to a refresh request, the table being stored in a second deployment and the table including a stream tracking change data capture information related to the table;
- transmitting, by the first deployment, the inventory to the second deployment;
- receiving, by the first deployment, an update snapshot from the second deployment, the update snapshot including information indicating changes on the table stored at the second deployment since a last refresh and including information regarding at least one select table version and at least one select partition for enabling replication of the stream, the at least one select partition being deleted in the table prior to current table version;
- and
- generating, by the first deployment, a refreshed replicated copy of the table at the second deployment based on the update snapshot, the refreshed replicated copy including a replicated copy of the stream using replicated copies of the at least one select table version and the at least one select partition, the stream being append-only stream recording row inserts into the table and not recording update and delete operations on the table.
Dependencies are inferred from the claim text.