US 2022/0188198 A1 · Storage System Backup and De-Duplication

Abstract

Techniques are provided for storage system backup and de-duplication. In an example, a file system stores a plurality of files. These files can be grouped into smaller sets through a series of iterations, where a set of files is similar to each other. Then, files of a set of files can be directly compared for duplicate information relative to each other, one copy of this duplicate information can be stored, and other copies can be discarded.

Drawings

Claims20

Dependent claims

A system, comprising:

a processor;
and
a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising:
converting respective files of a first group of files into respective groups of words that represent the respective files and respective frequencies with which respective words of the respective groups of words appear in the respective files;
based on an analysis of the respective groups of words and the respective frequencies according to a similarity criterion, grouping similar files of the first group of files into a second group of files;
determining a third group of files from the second group of files that each satisfy a function of a similarity threshold, the third group of files comprising a subgroup of the second group of files;
creating matrix data representative of a matrix that represents the third group of files, and data segments that are found within the third group of files;
storing a first data segment of the data segments;
and
storing a reference to the first data segment in place of storing a second data segment of the data segments in response to determining that the first data segment and the second data segment contain identical information.

7 more elements

Dependencies are inferred from the claim text.

Description9,243 words

Summary58 words

#The present application relates generally to storing files in computer storage systems.

#Computer storage systems can provide data storage, modification and access to multiple users. This data can be represented as files in a computer file system. In some examples, duplicate copies of data can be stored, and this duplicate data can be reduced through a de-duplication process.

Brief description of the drawings14 figures

#Numerous aspects, embodiments, objects, and advantages of the present embodiments will be apparent upon consideration of the following detailed description, taken in conjunction with the accompanying drawings, in which like reference characters refer to like parts throughout, and in which:

#FIG. 1 illustrates an example system architecture that can facilitate storage system backup and de-duplication, in accordance with certain embodiments of this disclosure;

#FIG. 2 illustrates an example de-duplication of data for storage system backup and de-duplication, in accordance with certain embodiments of this disclosure;

Detailed description8,779 words

#A feature of a storage system can be data protection. One approach with data protection can be to identify and eliminate redundant data. Eliminating redundant data can be done at the file level, and at the sub-file level, where a portion of a file is redundant relative to some other data and so is eliminated. This can generally be referred to as de-duplication.

#An approach to identifying data for de-duplication can utilize hashing. In some examples, file-level de-duplication can be performed quickly, but the check uses only file metadata, so can miss some duplicate data. In some examples, sub-file-level de-duplication can be time-consuming, and increase a back-up window that indicates how long a backup process takes to perform.

#Additionally, file-level de-duplication can detect and remove identical copies of the same files. While this can be implemented simply and performed quickly, it does not address the content inside the files. For example, two presentation deck files that have the exact same slides, but different titles will not be considered to be duplicates, so will be stored as two copies.

Facts

Application

17/119,627Filed 11 Dec 2020

Published

16 Jun 2022

Term ends

Not estimatedThe source records don’t support an estimate.

Classification9 codes

G06F 11/1453
Management of the data involved in backup or backup restore: using de-duplication of the data
G06F 16/116
File system administration, e.g. details of archiving or snapshots: details of conversion of file system types or formats
G06F 16/137
File access structures, e.g. distributed indices: hash-based
G06F 16/1748
Redundancy elimination performed by the file system: de-duplication implemented within the file system, e.g. based on file segments

Timeline

11 Dec 2020Application filedUS 17/119,627
11 Dec 2020Assigned to Emc IP Holding Company LLCassignment of assignor's interest
25 Feb 2021Assigned to Credit Suisse AG, Cayman Islands Branchsecurity agreement
3 Mar 2021Assigned to The Bank of New York Mellon Trust Company, N.A., AS Notes Collateral Agentsecurity interest
3 Mar 2021Assigned to The Bank of New York Mellon Trust Company, N.A., AS Notes Collateral Agentsecurity interest
3 Mar 2021Assigned to The Bank of New York Mellon Trust Company, N.A., AS Notes Collateral Agentsecurity interest
2 Nov 2021Assigned to Dell Products L.P., Emc IP Holding Company LLCrelease of security interest at reel 055408 frame 0697
10 Jun 2022Assigned to Emc IP Holding Company LLC, Dell Products L.P.release of security interest in patents previously recorded at reel/frame (055479/0342)
10 Jun 2022Assigned to Emc IP Holding Company LLC, Dell Products L.P.release of security interest in patents previously recorded at reel/frame (055479/0051)
10 Jun 2022Assigned to Emc IP Holding Company LLC, Dell Products L.P.release of security interest in patents previously recorded at reel/frame (056136/0752)
16 Jun 2022Published

Storage System Backup and De-Duplication

Life of this patent

Storage System Backup and De-Duplication

Life of this patent

Life of this patent

Abstract

Drawings

Drawings

Claims20

Description9,243 words

Drawings

Classification9 codes

Life of this patent

Description9,243 words