System and method for identifying and mitigating redundancies in stored data
AssigneeFalconStor, Inc.
InventorWai Lam
Life of this patent
Estimating the term…
Abstract
In an example of an embodiment of the invention, a repeating pattern is identified within stored data comprising a plurality of data files, each data file comprising at least a header section and a data section stored in an unknown format. At least one occurrence of the repeating pattern is identified as a header section of a respective data file, and a data section of the respective data file is identified based, at least in part, on a location of the at least one occurrence of the repeating pattern. The identified data section of the respective data file is backed up. Systems are also disclosed.
Claims20
A method to manage data comprising:
- examining a block of stored data comprising a plurality of data files, each data file comprising at least a header section and a data section, wherein the header section has an unknown format and unknown location within the block;
- identifying at least two occurrences of a repeating pattern within the examined block of stored data;
- based on the identification of the at least two occurrences determining that the repeating pattern comprises at least a portion of a header section of a respective data file;
- identifying a data section of the respective data file based, at least in part, on a location of the at least a portion of the header section;
- and
- backing up the identified data section of the respective data file.
A method to manage data comprising at least first and second components having unknown formats and locations, comprising:
- identifying a repeating pattern in data stored in a storage system;
- associating the pattern with at least one first component of a data structure within the stored data, wherein the first component has an unknown format and an unknown location within the data;
- identifying at least one a second component of the data structure, based at least in part on the identified first component;
- and
- performing a selected data processing operation with respect to the data structure.
A system to manage data comprising:
- means for examining a block of stored data comprising a plurality of data files, each data file comprising at least a header section and a data section, wherein the header section has an unknown format and an unknown location within the block;
- means for identifying a repeating pattern within the examined block of stored data;
- means for determining that the repeating pattern comprises at least a portion of a header section of a respective data file;
- means for identifying a data section of the respective data file based, at least in part, on a location of the at least a portion of the header section;
- and
- means for backing up the identified data section of the respective data file.
A system to manage data comprising:
- a memory located in a storage system, the memory being configured to store data;
- and
- a processor configured to:
- examine a block of stored data comprising a plurality of data files, each data file comprising at least a header section and a data section, wherein the header section has an unknown format and an unknown location within the block;
- identify at least two occurrences of a repeating pattern within the examined block of stored data;
- based on the identification of the at least two occurrences, determine that the repeating pattern comprises at least a portion of a header section of a respective data file;
- identify a data section of the respective data file based, at least in part, on a location of the at least a portion of the determined header section;
- and
- back up the identified data section of the respective data file.
Dependencies are inferred from the claim text.