Asynchronous data replication in a multiple availability zone cloud platform

A non-transitory, computer-readable medium coupled to one or more processors and having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:

• storing metadata for one or more files for the asynchronous data replication from a first availability zone to a second availability zone of the multiple availability zone cloud environment, wherein the metadata is stored at an in-memory data grid of a first instance of a storage service at the first availability zone of the multiple availability zone cloud environment, wherein the in-memory data grid includes a queue data structure of metadata records and a map of metadata records, wherein the queue data structure includes one or more records corresponding to one or more operations executed on a first file from the one or more files for the asynchronous data replication, wherein the first file is stored at a first file storage at the first availability zone, wherein the one or more records corresponding to the first file are associated with one or more respective versions of the first file created based on the one or more operations
• to store content for the first file based on received requests for the first file at the first file storage, and wherein the map of metadata records identifies the files that are to be replicated and includes information for a request associated with a latest operation performed on each of the files;
• and
• in response to determining that a connection from the first availability zone to the second availability zone is available, executing the asynchronous data replication for the first file identified at the map, wherein the execution includes:
• determining the first file for replication that is identified at the map;
• reading the stored metadata for the first file for replication from the queue data structure to determine a replication operation based on the one or more records identified for the first file at the queue data structure and at the map, wherein the stored metadata is read iteratively until a record from the one or more records stored at the queue for the first file for replication is determined to match information for the first file at the map, wherein the replication operation is determined to correspond to a latest operation performed on the first file as included in the information for the first file at the map;
• reading, by a replication executor at the first instance of the storage service, the first file from the first file storage;
• and
• providing a replication operation for executing replication by the replication executor at the first instance of the storage service, wherein the first file is replicated at a second file storage at the second availability zone by providing the first file to a replication interface of a second instance of the storage service at the second availability zone.

A system comprising

• a computing device;
• and
• a computer-readable storage device coupled to the computing device and having instructions stored thereon which, when executed by the computing device, cause the computing device to perform operations, the operations comprising:
• storing metadata for one or more files for the asynchronous data replication from a first availability zone to a second availability zone of the multiple availability zone cloud environment, wherein the metadata is stored at an in-memory data grid of a first instance of a storage service at the first availability zone of the multiple availability zone cloud environment, wherein the in-memory data grid includes a queue data structure of metadata records and a map of metadata records, wherein the queue data structure includes one or more records corresponding to one or more operations executed on a first file from the one or more files for the asynchronous data replication, wherein the first file is stored at a first file storage at the first availability zone, wherein the one or more records corresponding to the first file are associated with one or more respective versions of the first file created based on the one or more operations to store content for the first file based on received requests for the first file at the first file storage, and wherein the map of metadata records identifies the files that are to be replicated and includes information for a request associated with a latest operation performed on each of the files;
• and
• in response to determining that a connection from the first availability zone to the second availability zone is available, executing the asynchronous data replication for the first file identified at the map, wherein the execution includes:
• determining the first file for replication that is identified at the map;
• reading the stored metadata for the first file for replication from the queue data structure to determine a replication operation based on the one or more records identified for the first file at the queue data structure and at the map, wherein the stored metadata is read iteratively until a record from the one or more records stored at the queue for the first file for replication is determined to match information for the first file at the map, wherein the replication operation is determined to correspond to a latest operation performed on the first file as included in the information for the first file at the map;
• reading, by a replication executor at the first instance of the storage service, the first file from the first file storage;
• and
• providing a replication operation for executing replication by the replication executor at the first instance of the storage service, wherein the first file is replicated at a second file storage at the second availability zone by providing the first file to a replication interface of a second instance of the storage service at the second availability zone.