System and method for managing replicas of objects in a distributed storage system

A system for generating replication requests for objects in a distributed storage system, comprising:

• one or more processors;
• memory;
• and
• one or more programs stored in the memory, the one or more programs comprising instructions to:
• generate replication requests for objects in a distributed storage system based at least in part on replication policies for the objects and a current state of the distributed storage system, wherein a respective replication request for a respective object instructs a respective instance of the distributed storage system to replicate the respective object so as to at least partially satisfy a replication policy for the respective object, wherein a respective replication policy includes criteria specifying at least storage device types on which replicas of object are to be stored;
• partition the replication requests into groups of respective replication requests corresponding to respective instances of the distributed storage system at which the respective replication requests are to be performed;
• and
• for a respective group of respective replication requests,
• determine a respective subset of replication requests for the respective group of respective replication requests that can be completed within a predetermined time interval;
• and
• distribute the respective subset of replication requests for the respective group of respective replication requests to the respective instance of the distributed storage system corresponding to the respective group of respective replication requests for execution.

A non-transitory computer readable storage medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions to:

• generate replication requests for objects in a distributed storage system based at least in part on replication policies for the objects and a current state of the distributed storage system, wherein a respective replication request for a respective object instructs a respective instance of the distributed storage system to replicate the respective object so as to at least partially satisfy a replication policy for the respective object, wherein a respective replication policy includes criteria specifying at least storage device types on which replicas of object are to be stored;
• partitioning the replication requests into groups of respective replication requests corresponding to respective instances of the distributed storage system at which the respective replication requests are to be performed;
• and
• for a respective group of respective replication requests,
• determining a respective subset of replication requests for the respective group of respective replication requests that can be completed within a predetermined time interval;
• and
• distribute the respective subset of replication requests for the respective group of respective replication requests to the respective instance of the distributed storage system corresponding to the respective group of the respective requests for execution.