Using a storage system to optimize and maintain the metadata associated with a plurality of small files

A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

• determining that a size associated with a first content file is less than a threshold size, wherein metadata of the first content file is organized using a first file metadata structure, wherein the first file metadata structure comprises a first root node, a first plurality of intermediate nodes, and a first plurality of leaf nodes with corresponding references to data chunks of the first content file;
• in response to a determination that the size associated with the first content file is less than the threshold size, updating a combined metadata structure at least in part by combining in the combined metadata structure metadata of the first content file with metadata of a second content file included in a second file metadata structure, wherein the size associated with the second content file is less than the file threshold size, wherein the second file metadata structure comprises a second root node, a second plurality of intermediate nodes, and a second plurality of leaf nodes with corresponding references to data chunks of the second content file, wherein the combined metadata structure at least includes a third root node, the first plurality of leaf nodes, and the second plurality of leaf nodes;
• and
• updating a tree data structure to reference a first portion of the combined metadata structure corresponding to the first content file and to reference a second portion of the combined metadata structure corresponding to the second content file.

A system, comprising:

• one or more processors configured to:
• determine that a size associated with a first content file is less than a threshold size, wherein metadata of the first content file is organized using a first file metadata structure, wherein the first file metadata structure comprises a first root node, a first plurality of intermediate nodes, and a first plurality of leaf nodes with corresponding references to data chunks of the first content file;
• in response to a determination that the size associated with the first content file is less than the threshold size, update a combined metadata structure at least in part by combining in the combined metadata structure metadata of the first content file with metadata of a second content file included in a second file metadata structure, wherein the size associated with the second content file is less than the file threshold size, wherein the second file metadata structure comprises a second root node, a second plurality of intermediate nodes, and a second plurality of leaf nodes with corresponding references to data chunks of the second content file, wherein the combined metadata structure at least includes a third root node, the first plurality of leaf nodes, and the second plurality of leaf nodes;
• and
• update a tree data structure to reference a first portion of the combined metadata structure corresponding to the first content file and to reference a second portion of the combined metadata structure corresponding to the second content file;
• and
• a memory coupled to the one or more processors and configured to provide the one or more processors with instructions.