Backing up database files in a distributed system

An apparatus, comprising:

• a processor;
• memory coupled with the processor;
• and
• instructions stored in the memory and executable by the processor to cause the apparatus to:
• receive, at a data management system, a request to generate backup data for a plurality of data files from one or more databases;
• generate, at the data management system in response to the request, a file comprising a plurality of partitions, wherein, after generation of the plurality of partitions:
• each partition included in the plurality of partitions corresponds to a respective group of data files from among the plurality of data files,
• each partition included in the plurality of partitions comprises a respective group of shard files that corresponds to the respective group of data files for the partition, and
• for each partition within the plurality of partitions, the respective group of shard files for the partition comprises:
• a metadata shard file that comprises metadata associated with the partition, wherein the metadata comprises a list of the respective group of data files for the partition;
• and
• one or more additional shard files representative of the respective group of data files for the partition;
• and
• distribute, by the data management system, the respective groups of shard files to a plurality of nodes within a distributed backup system, the respective groups of shard files comprising the backup data.

A non-transitory computer-readable medium storing code, the code comprising instructions executable by a processor to:

• receive, at a data management system, a request to generate backup data for a plurality of data files from one or more databases;
• generate, at the data management system in response to the request, a file comprising a plurality of partitions, wherein, after generation of the plurality of partitions:
• each partition included in the plurality of partitions corresponds to a respective group of data files from among the plurality of data files,
• each partition included in the plurality of partitions comprises a respective group of shard files that corresponds to the respective group of data files for the partition, and
• for each partition within the plurality of partitions, the respective group of shard files for the partition comprises:
• a metadata shard file that comprises metadata associated with the partition, wherein the metadata comprises a list of the respective group of data files for the partition;
• and
• one or more additional shard files representative of the respective group of data files for the partition;
• and
• distribute, by the data management system, the respective groups of shard files to a plurality of nodes within a distributed backup system, the respective groups of shard files comprising the backup data.