Metadata compaction in a distributed storage system
AssigneeWestern Digital Technologies, Inc.
InventorsKoen Struyve, Thomas Demoor, Wim Vander Schelden
Life of this patent
Estimating the term…
Abstract
Systems and methods for metadata compaction in a distributed storage system with a file system interface are described. A file system interface and an object storage system interface use a metadata index for mapping object identifiers from the object storage system to location identifiers for the file system. When the metadata index includes a number of entries for continuous data blocks with overlapping intervals, a defragmentation operation may generate a defragmented entry for a defragmentation interval overlapping the overlapping data blocks.
Claims20
A system, comprising:
- a file system interface configured to process file data requests for data from a file system client;
- an object storage system interface configured to process object storage requests to an object storage system;
- and
- a metadata index manager configured to:
- manage a metadata index, wherein:
- the metadata index includes a plurality of entries;
- each entry of the plurality of entries includes:
- an object identifier for the object storage system;
- and
- a file system location identifier for a block of data;
- and
- the plurality of entries includes a plurality of continuous data blocks;
- and
- generate, responsive to a defragmentation operation, a defragmented entry in the metadata index, wherein the defragmented entry includes a defragmentation interval traversing the plurality of continuous data blocks.
A computer-implemented method, comprising:
- processing, through a file system interface, file data requests for data from a file system client;
- processing, through an object storage system interface, object storage requests to an object storage system;
- managing a metadata index, wherein:
- the metadata index includes a plurality of entries;
- each entry of the plurality of entries includes:
- an object identifier for the object storage system;
- and
- a file system location identifier for a block of data;
- and
- the plurality of entries includes a plurality of continuous data blocks with continuous intervals;
- and
- generating, responsive to a defragmentation operation, a defragmented entry in the metadata index, wherein the defragmented entry includes a defragmentation interval traversing the plurality of continuous data blocks.
A system, comprising:
- means for processing, through a file system interface, file data requests for data from a file system client;
- means for processing, through an object storage system interface, object storage requests to an object storage system;
- means for managing a metadata index, wherein:
- the metadata index includes a plurality of entries;
- each entry of the plurality of entries includes:
- an object identifier for the object storage system;
- and
- a file system interface location identifier for a block of data;
- and
- the plurality of entries includes a plurality of continuous data blocks with continuous intervals;
- and
- means for generating, responsive to a defragmentation operation, a defragmented entry in the metadata index, wherein the defragmented entry includes a defragmentation interval traversing the plurality of continuous data blocks.
Dependencies are inferred from the claim text.