Snapshot metadata arrangement for efficient cloud integrated data management

A non-transitory machine-readable medium having stored thereon instructions for managing snapshots for backup and restore operations comprising machine executable code that, when executed by at least one machine, causes the machine to:

• identify a key-value store for a data collection based on a data collection in one or more file systems maintained by one or more data source devices based on a data collection identifier included in a snapshot restore request, wherein the snapshot restore request further comprises a source snapshot identifier identifying a snapshot;
• retrieve a first plurality of records from the key-value store using a local snapshot identifier as a key prefix for each of the first plurality of records, wherein the first plurality of records comprises at least data map records and the local snapshot identifier is mapped to the source snapshot identifier in metadata for the data collection;
• assemble data blocks from a snapshot data file into a data buffer according to offsets in the data map records that map to locations in the snapshot data file;
• and
• send via a data storage network the data buffer to a backup application hosted by a restore target identified in the snapshot restore request and configured to reassemble the data blocks into files associated with the snapshot to satisfy the snapshot restore request, wherein the snapshot data file is identified using the local snapshot identifier, comprises an aggregation of file data for the files, and is retrieved from one or more cloud storage devices.

A computing device, comprising:

• a memory containing a non-transitory machine-readable medium comprising machine executable code having stored thereon instructions for managing snapshots to facilitate efficient backup and restore operations in data storage networks;
• and
• a processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to:
• retrieve a first plurality of records from a key-value store for a data collection using a local snapshot identifier as a key prefix in response to a snapshot restore request comprising a source snapshot identifier identifying the data collection, wherein data collection is hosted in one or more file systems maintained by one or more data source devices and the first plurality of records comprises at least data map records and the local snapshot identifier is mapped to the source snapshot identifier;
• assemble data blocks from a snapshot data file into a data buffer according to offsets in the data map records that map to locations in a snapshot data file, wherein the snapshot data file is identified using the local snapshot identifier, comprises an aggregation of file data for files associated with the snapshot, and is retrieved from one or more cloud storage devices;
• and
• send via a data storage network at least the data buffer and the data map records to a backup application hosted by a restore target and configured to reassemble the data blocks into the files to satisfy the snapshot restore request.