Distributed replication of an object

A system comprising:

• a processor-based system executed on a computer system and configured to:
• fetch, by a first source worker node at a source site, a first task from a message queue, the first task specifying replicating a first object at the source site to a destination site;
• issue, from the first source worker node to the destination site, a first request for a first connection, the first request being received by a load balancer at the destination site and assigned to a first destination worker node;
• establish the first connection between the first source and destination worker nodes;
• determine that the destination site does not include an object having a same name, timestamp, size, and checksum as the first object;
• upon the determination, perform between the first source worker node and the first destination worker node a deduplication of segments into which the first object has been divided;
• and
• transmit from the first source worker node to the first destination worker node the deduplicated segments of the first object for storage at the destination site.

A computer program product comprising a non-transitory computer-readable medium having a computer-readable program code embodied therein, the computer-readable program code adapted to be executed by one or more processors to implement a method comprising:

• fetching, by a first source worker node at a source site, a first task from a message queue, the first task specifying replicating a first object at the source site to a destination site;
• issuing, from the first source worker node to the destination site, a first request for a first connection, the first request being received by a load balancer at the destination site and assigned to a first destination worker node;
• establishing the first connection between the first source and destination worker nodes;
• determining that the destination site does not include an object having a same name, timestamp, size, and checksum as the first object;
• upon the determining, performing between the first source worker node and the first destination worker node a deduplication of segments into which the first object has been divided;
• and
• transmitting from the first source worker node to the first destination worker node the deduplicated segments of the first object for storage at the destination site.