Automatic data replica manager in distributed caching and data processing systems
AssigneeSamsung Electronics Co., Ltd.
InventorsZhengyu Yang, Jiayin Wang, Thomas David Evans
Life of this patent
Estimating the term…
Abstract
A method of data storage includes determining a latency distance from a primary node to each of two or more replica nodes, choosing a preferred replica node of the two or more replica nodes based on the determined latency distances, and write-caching data into the preferred replica node.
Claims9
A method of data storage, the method comprising:
- determining a latency distance from a primary node to two or more replica nodes in a tier;
- choosing a preferred replica node of the two or more replica nodes based on the determined latency distances;
- and
- migrating replica data from a second replica node of the two or more replica nodes to the preferred replica node using a fusion cache method comprising:
- write-caching new data from the primary node to the preferred replica node;
- copying the replica data from the second replica node to the preferred replica node;
- and
- maintaining the replica data existing data on the second replica node, wherein the migration of the replica data from the second replica node to the preferred replica node is performed during operation of a system comprising the preferred replica node.
A method of using replicated data to enable parallel prefetching from nodes of a datacenter cluster, the method comprising:
- splitting a dataset into two parts;
- loading the two parts of the dataset from corresponding nodes comprising a primary node of the datacenter cluster, and a replica node of the datacenter cluster;
- determining a difference between an access speed corresponding to the replica node and an access speed corresponding to the primary node exceeds a threshold, or determining a utilization ratio of throughput corresponding to the replica node is less than an operating threshold;
- and
- triggering parallel prefetching of the dataset from the primary node and the replica node, such that a makespan of the parallel prefetchinq is less than reading the two parts of the dataset from the primary node.
A method of using replicated data to enable parallel prefetching from multiple nodes of a datacenter cluster, the method comprising:
- splitting a dataset into two parts;
- loading the two parts of the dataset from corresponding nodes comprising a primary node of the datacenter cluster, and a replica node of the datacenter cluster;
- determining a difference between an access speed corresponding to the replica node and an access speed corresponding to the primary node exceeds a threshold, or determining a utilization ratio of throughput corresponding to the replica node is less than an operating threshold;
- determining a ratio of a total size of the dataset to an access speed of a solid-state drive of the primary node is greater than or equal to a maximum of a ratio of a size of a first of the two parts from the solid-state drive of the primary node to an access speed of the solid-state drive of the primary node and a ratio of a size of a second of the two parts from a solid-state drive of the replica node to an access speed of the solid-state drive of the replica node;
- and
- triggering parallel prefetching.
Dependencies are inferred from the claim text.