Systems and methods for load-aware data replication using hierarchical queues

A system comprising:

• a memory;
• a processing device operatively coupled to the memory, configured to:
• receive, by a target data repository from a source data repository, a checkpoint describing one or more updates to one or more datasets;
• add the checkpoint to a first set of queues assigned to one or more pods of the target data repository, wherein operations in the first set of queues have a higher priority than operations in a second set of queues assigned to one or more volumes of the target data repository;
• and
• service an operation from the first set of queues based on the higher priority.

A non-transitory computer readable storage medium storing instructions that, when executed, cause a processing device to:

• receive, by a target data repository from a source data repository, a checkpoint describing one or more updates to one or more datasets;
• add the checkpoint to a first set of queues assigned to one or more pods of the target data repository, wherein operations in the first set of queues have a higher priority than operations in a second set of queues assigned to one or more volumes of the target data repository;
• and
• service an operation from the first set of queues based on the higher priority.