Limited deduplication scope for distributed file systems
AssigneeEMC IP Holding Company LLC
InventorsRajiv Desai, Niraj Tolia
Life of this patent
Estimating the term…
Abstract
A method, article of manufacture, and apparatus for limited deduplication scope on a distributed file system is discussed. A write request is received from a client at the metadata server (“MDS”), where the write request comprises a data object identifier and a preferred object store identifier. The MDS determines whether a preferred object store associated with the preferred object store identifier contains a copy of a data object associated with the data object identifier. A write URL comprising the data object identifier and a object store location associated with the preferred object store is transmitted to the client when the preferred object store does not contain the copy of the data object.
Claims18
A method for reading a data object in a distributed file system that includes a metadata server (MDS), the method comprising:
- receiving a read request from a client at the metadata server, wherein the read request comprises a data object identifier and a preferred object store identifier;
- determining at the MDS whether a preferred object store associated with the preferred object store identifier contains a copy of a data object associated with the data object identifier, wherein the MDS is separate from the preferred object store;
- and
- transmitting a read URL comprising the data object identifier and an object store location associated with the preferred object store to the client when the preferred object store does not contain the copy of the data object, wherein the client reads the data object from the preferred object store using the read URL, wherein communications between the client and the MDS are independent and separate from communications between the client and the preferred object store.
A method for writing a data object in a distributed file system (DFS) that includes a metadata server (MDS) and a plurality of object stores, the method comprising:
- receiving a write request from a client at the MDS to write a data object to the DFS, wherein the write request comprises a data object identifier and a preferred object store identifier;
- determining whether a preferred object store identified by the preferred object store identifier is available;
- storing the preferred object store identifier and the data object identifier at the MDS when the preferred object store is available;
- and
- transmitting a write URL comprising the data object identifier and an object store location associated with the preferred object store to the client when the preferred object store is available, wherein the client writes the data object to the preferred object store using the write URL.
A non-transitory computer readable medium comprising computer executable instructions for performing a method for writing a data object in a distributed file system (DFS) that includes a metadata server (MDS) and a plurality of object stores, the method comprising:
- receiving a write request from a client at the MDS to write a data object to the DFS, wherein the write request comprises a data object identifier and a preferred object store identifier;
- determining whether a preferred object store identified by the preferred object store identifier is available;
- storing the preferred object store identifier and the data object identifier at the MDS when the preferred object store is available;
- and
- transmitting a write URL comprising the data object identifier and an object store location associated with the preferred object store to the client when the preferred object store is available, wherein the client writes the data object to the preferred object store using the write URL.
Dependencies are inferred from the claim text.