Replication of hot data ranges in distributed transactional key-value stores
AssigneeSnowflake Inc.
InventorsAnkita Kejriwal, Lanyue Lu, Evan J. Tschannen, Xiaoxi Wang, Zhongxing Zhang
Life of this patent
Estimating the term…
Abstract
A hot server is identified from a plurality of servers based on one or more server metrics associated with the hot server. A hot data range stored by the hot server is identified based on one or more read density metrics. The hot data range comprises a range of data values with a higher volume of access requests compared to other data values stored by the hot server. The hot data range is replicated across a number of additional servers.
Claims20
A system comprising:
- at least one hardware processor;
- and
- at least one memory storing instructions that cause the at least one hardware processor to perform operations comprising:
- identifying a hot server from a plurality of servers based on one or more server metrics associated with the hot server,
- identifying a hot data range stored by the hot server based on one or more read density metrics associated with the hot data range, the hot data range comprising a range of data values with a higher volume of access requests relative to other data values stored by the hot server;
- based on identifying the hot data range, replicating the hot data range across a number of additional servers;
- determining, based on updated read density metrics associated with the hot data range, that the hot data range is no longer hot;
- and
- based on determining that the hot data range is no longer hot, reducing a number of replicas of the hot data range, the reducing of the number of replicas comprising causing the hot data range to be deleted from one or more servers.
A method comprising:
- monitoring, by a data distributor comprising at least one processor, a plurality of server metrics of a plurality of servers implementing a key-value store;
- identifying, by the data distributor, a hot server from the plurality of servers based on one or more server metrics of the hot server;
- identifying, by the hot server, a hot data range stored by the hot server based on one or more read density metrics associated with the hot data range, the hot data range comprising a range of data values with a higher volume of access requests relative to other data values stored by the hot server;
- based on identifying the hot data range, replicating the hot data range across a number of additional servers;
- determining, based on updated read density metrics associated with the hot data range, that the hot data range is no longer hot;
- and
- based on determining that the hot data range is no longer hot, reducing a number of replicas of the hot data range, the reducing of the number of replicas comprising causing the hot data range to be deleted from one or more servers.
Computer-storage media comprising instructions that, when executed by one or more processors of a machine, configure the machine to perform operations comprising:
- monitoring a plurality of server metrics of a plurality of servers implementing a key-value store;
- identifying a hot server from the plurality of servers based one or more server metrics of the hot server;
- identifying a hot data range stored by the hot server based on one or more read density metrics associated with the hot data range, the hot data range comprising a range of data values with a higher volume of access requests relative to other data values stored by the hot server;
- based on identifying the hot data range, replicating the hot data range across a number of additional servers;
- determining, based on updated read density metrics associated with the hot data range, that the hot data range is no longer hot;
- and
- based on determining that the hot data range is no longer hot, reducing a number of replicas of the hot data range, the reducing of the number of replicas comprising causing the hot data range to be deleted from one or more servers.
Dependencies are inferred from the claim text.