Utilizing fixed-sized and variable-length data chunks to perform source side deduplication

Non-transitory computer readable media storing computer instructions that, when executed by a processor of a source computing system, cause the processor to execute a backup agent to:

• receive, from a storage system, range information associated with one or more objects, the range information including a plurality of range chunk identifiers, wherein each of the plurality of range chunk identifiers identifies a corresponding range of chunks within a corresponding object of the one or more objects stored as one or more fixed-length data bricks, wherein each of the one or more fixed-length data bricks includes one or more variable-length data chunks identified in the range of chunks, and each of the fixed-length data bricks is associated with brick metadata that includes a respective one of the plurality of range chunk identifiers;
• based on the plurality of range chunk identifiers included in the range information received from the storage system, determine at least one of one or more missing ranges or one or more mismatched ranges associated with the one or more objects, wherein:
• determining the one or more mismatched ranges includes comparing a range chunk identifier from the plurality of range chunk identifiers that corresponds to a portion of the one or more objects to a current range chunk identifier that corresponds to the portion of the one or more objects,
• a mismatched range of the one or more mismatched ranges exists when the range chunk identifier identifies a different range of data chunks than a range of data chunks of the current range chunk identifier, and
• a missing range of the one or more missing ranges exists when the range information does not cover a range corresponding to the current range chunk identifier;
• provide, to the storage system, a plurality of data chunk identifiers associated with the one or more variable-length data chunks included in the at least one of the one or more missing ranges or the one or more mismatched ranges associated with the one or more objects;
• receive, from the storage system, a response that is used to identify, among the one or more of variable-length data chunks, one or more variable-length data chunks not already stored in a storage associated with the storage system;
• and
• provide, to the storage system, content of the one or more variable-length data chunks.

A system, comprising:

• a processor of a source computing system configured to execute a backup agent to:
• receive, from a storage system, range information associated with one or more objects, the range information including a plurality of range chunk identifiers, wherein each of the plurality of range chunk identifiers identifies a corresponding range of chunks within a corresponding object the one or more objects stored as one or more fixed-length data bricks, wherein each of the one or more fixed-length data bricks includes one or more variable-length data chunks identified in the range of chunks, and each of the fixed-length data bricks is associated with brick metadata that includes a respective one of the plurality of range chunk identifiers;
• based on the plurality of range chunk identifiers included in the range information received from the storage system, determine at least one of one or more missing ranges or one or more mismatched ranges associated with the one or more objects, wherein:
• determining the one or more mismatched ranges includes comparing a range chunk identifier from the plurality of range chunk identifiers that corresponds to a portion of the one or more objects to a current range chunk identifier that corresponds to the portion of the one or more objects,
• a mismatched range of the one or more mismatched ranges exists when the range chunk identifier identifies a different range of data chunks than a range of data chunks of the current range chunk identifier, and
• a missing range of the one or more missing ranges exists when the range information does not cover a range corresponding to the current range chunk identifier;
• provide, to the storage system, a plurality of data chunk identifiers associated with the one or more variable-length data chunks included in the at least one of the one or more missing ranges or the one or more mismatched ranges associated with the one or more objects;
• receive, from the storage system, a response that is used to identify among the plurality of variable-length data chunks, one or more variable-length data chunks not already stored in a storage associated with the storage system;
• and
• provide, to the storage system, content of the one or more variable-length data chunks;
• and
• a memory coupled to the processor and configured to provide the processor with instructions for executing the backup agent.