System and method for identifying and mitigating redundancies in stored data
AssigneeFalconStor, Inc.
InventorWai Lam
Life of this patent
Estimating the term…
Abstract
In an example of an embodiment of the invention, a repeating pattern is identified within stored data comprising a plurality of data files, each data file comprising at least a header section and a data section stored in an unknown format. At least one occurrence of the repeating pattern is identified as a header section of a respective data file, and a data section of the respective data file is identified based, at least in part, on a location of the at least one occurrence of the repeating pattern. The identified data section of the respective data file is backed up. Systems are also disclosed.
Claims59
A method to manage data, comprising:
- identifying a repeating pattern within stored data comprising a plurality of data files, each data file comprising at least a header section and a data section stored in an unknown format;
- identifying at least one occurrence of the repeating pattern as a header section of a respective data file;
- identifying a data section of the respective data file based, at least in part, on a location of the at least one occurrence of the repeating pattern;
- and
- backing up the identified data section of the respective data file.
A method to manage data, comprising:
- identifying a repeating pattern in data stored in a storage system;
- associating the pattern with at least a first component of a data structure within the stored data;
- identifying at least a second component of the data structure, based at least in part on the pattern;
- and
- performing a selected data processing operation with respect to the data structure.
A method to manage data structures, comprising:
- identifying a repeating pattern within data stored in a first storage system;
- identifying a data section associated with a data file stored in the first storage system, based at least in part on a location of the pattern;
- computing a value based at least in part on the data section;
- comparing the computed value to one or more second values stored in a database;
- and
- if the computed value is not found in the database:
- storing the computed value in the database;
- storing the data section in a second storage system;
- and
- replacing the data section stored in the first storage system by the computed value.
An apparatus to manage data structures, comprising:
- means for identifying a repeating pattern in data stored in a storage system;
- means for associating the pattern with at least a first component of a data structure within the stored data;
- means for identifying at least a second component of the data structure, based at least in part on a location of the pattern;
- and
- means for performing a selected data processing operation with respect to the data structure.
A system to manage data structures, comprising:
- a memory located in a storage system, the memory being configured to store data;
- and
- a processor configured to:
- identify a repeating pattern in the data;
- associate the pattern with at least a first component of a data structure within the stored data;
- identify at least a second component of the data structure, based at least in part on the pattern;
- and
- perform a selected data processing operation with respect to the data structure.
A system to manage data structures, comprising:
- a memory located in a first storage system, the memory being configured to store data;
- and
- a processor configured to:
- identify a repeating pattern within data stored in the first storage system;
- identify a data section associated with a data file stored in the first storage system, based at least in part on a location of the pattern;
- compute a value based on the data section;
- compare the computed value to one or more second values stored in a database;
- and
- if the computed value is not found in the database:
- store the computed value in the database;
- store the data section in a second storage system;
- and
- replace the data section stored in the first storage system by the computed value.
Dependencies are inferred from the claim text.