Back to results
US 8,898,107 B1Granted
Managing deduplication of stored data
AssigneePermabit Technology Corporation
InventorsJered J. Floyd, Michael Fortson, Assar Westerlund, Jonathan Coburn
Life of this patent
Estimating the term…
Abstract
In one aspect, in general, a method for managing data in a data storage system comprises receiving data to be stored in the data storage system, computing values corresponding to different respective portions of the received data, generating identifiers corresponding to different respective portions of the received data, with an identifier corresponding to a particular portion of data including the computed value corresponding to the particular portion of data and metadata indicating a location where the particular portion of data is being stored in the data storage system, and storing at least some of the identifiers in an index until the index reaches a predetermined size.
Claims40
A method for managing data in a data storage system, the method comprising:
- receiving, at a data deduplication engine associated with the data storage system, data to be stored in the data storage system;
- and
- providing, by the data deduplication engine, deduplication advice to a software layer based on real-time analysis of the received data by:
- computing values corresponding to different respective portions of the received data;
- generating identifiers corresponding to different respective portions of the received data, with an identifier corresponding to a particular portion of data including the computed value corresponding to the particular portion of data and accompanying metadata associated with the particular portion of data;
- storing at least some of the identifiers in an index of a predetermined size;
- and
- in response to determining that a first identifier corresponding to a first portion of the received data was not already stored in the index before the first portion of data was received, indicating, as the deduplication advice provided before the first portion of the received data is stored in the data storage system, that the first identifier may be stored in the index and the first portion of the received data may be stored in the data storage system;
- and
- designating one or more identifiers for removal from the index, at least some of the identifiers being among those that have been least recently added to or updated in the index.
7 more elements
A method for managing data in a data storage system, the method comprising:
- receiving, at substantially the same time, data to be stored in the data storage system at both the data storage system and a data deduplication engine associated with the data storage system;
- and
- providing, by the data deduplication engine, deduplication advice to a software layer based on analysis of the data received at the data deduplication engine by:
- computing values corresponding to different respective portions of the data received at the data deduplication engine;
- generating identifiers corresponding to different respective portions of the data received at the data deduplication engine, with an identifier corresponding to a particular portion of the data including the computed value corresponding to the particular portion of data and accompanying metadata associated with the particular portion of data;
- storing at least some of the identifiers in an index of a predetermined size;
- and
- in response to determining that a first identifier corresponding to a first portion of the data received at the data deduplication engine was already stored in the index before the first portion was received, indicating, as the deduplication advice, the removal of the first identifier from the index and that the data storage system is be to asynchronously updated to remove the corresponding first portion of the data stored in the data storage system;
- and
- designating one or more identifiers for removal from the index, at least some of the identifiers being among those that have been least recently added to or updated in the index.
7 more elements
A method for managing data in a data storage system, the method comprising:
- receiving, at a data deduplication engine, data stored in the data storage system;
- providing, by the data deduplication engine, deduplication advice to a software layer based on analysis of the received data by:
- computing values corresponding to different respective portions of the received data;
- generating identifiers corresponding to different respective portions of the received data, with an identifier corresponding to a particular portion of the data including the computed value corresponding to the particular portion of data and accompanying metadata associated with the particular portion of data;
- storing at least some of the identifiers in an index of a predetermined size;
- and
- in response to determining that a first identifier corresponding to a first portion of the received data was already stored in the index before the first portion of the received data was received, indicating, as the deduplication advice, the removal of the first identifier from the index and that the data storage system is be to asynchronously updated to remove the corresponding first portion of the data stored in the data storage system;
- and
- designating one or more identifiers for removal from the index, at least some of the identifiers being among those that have been least recently added to or updated in the index.
6 more elements
Dependencies are inferred from the claim text.