System and method for discovery and retrieval using an enumerator
AssigneeDell Products L.P.
InventorsDharmesh M. Patel, Rizwan Ali, Ravikanth Chaganti
Life of this patent
Estimating the term…
Abstract
A data storage system includes storage and a global enumerator. The storage stores data chunks, object level metadata associated with portions of the data chunks, and chunk level metadata associated with respective data chunks. The global enumerator obtains a data access request that includes a metadata characteristic; in response to obtaining the data access request: matches the metadata characteristic to at least one of the data chunks based on at least one selected from a group consisting of the object level metadata and the chunk level metadata; and provides a response based on the at least one data chunk of the data chunks in response to the data access request.
Claims17
A data storage system, comprising:
- storage for storing:
- data chunks,
- object level metadata associated with portions of the data chunks, and
- chunk level metadata associated with respective data chunks;
- and
- a global enumerator programmed to:
- obtain a data access request comprising a metadata characteristic;
- in response to obtaining the data access request:
- match the metadata characteristic to at least one of the data chunks based on at least one selected from a group consisting of the object level metadata and the chunk level metadata;
- and
- provide a response, based on the at least one data chunk of the data chunks, in response to the data access request;
- and
- a plurality of regional enumerators associated with respective regions that store respective portions of the data chunks,
- wherein matching the metadata characteristic to the at least one of the data chunks comprises:
- identifying a portion of the regions in which respective portions of the data chunks are stored that include the at least one of the data chunks;
- generating a plurality of sub-requests, based on the data access request, for respective regions of the portion of the regions;
- distributing the sub-requests to a portion of the plurality of the regional enumerators based on the portion of the regions;
- and
- aggregating responses to the sub-requests from the portion of the plurality of the regional enumerators.
A method for managing a data storage system, comprising:
- obtaining a data access request comprising a metadata characteristic;
- in response to obtaining the data access request:
- matching the metadata characteristic to at least one data chunk of data chunks managed by the data storage system based on at least one selected from a group consisting of object level metadata and chunk level metadata;
- and
- providing a response, based on the at least one data chunk of the data chunks, in response to the data access request,
- wherein matching the metadata characteristic to the at least one of the data chunks comprises:
- identifying a portion of regions in which respective portions of the data chunks are stored that include the at least one of the data chunks;
- generating a plurality of sub-requests, based on the data access request, for respective regions of the portion of the regions;
- distributing the sub-requests to a portion of a plurality of regional enumerators based on the portion of the regions;
- and
- aggregating responses to the sub-requests from the portion of the plurality of the regional enumerators.
A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for managing a data storage system, the method comprising:
- obtaining a data access request comprising a metadata characteristic;
- in response to obtaining the data access request:
- matching the metadata characteristic to at least one data chunk of data chunks managed by the data storage system based on at least one selected from a group consisting of object level metadata and chunk level metadata;
- and
- providing a response, based on the at least one data chunk of the data chunks, in response to the data access request,
- wherein matching the metadata characteristic to the at least one of the data chunks comprises:
- identifying a portion of regions in which respective portions of the data chunks are stored that include the at least one of the data chunks;
- generating a plurality of sub-requests, based on the data access request, for respective regions of the portion of the regions;
- distributing the sub-requests to a portion of a plurality of regional enumerators based on the portion of the regions;
- and
- aggregating responses to the sub-requests from the portion of the plurality of the regional enumerators.
Dependencies are inferred from the claim text.