# US 8,280,859 B2 · Method and system for assuring integrity of deduplicated data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,280,859 B2
- Document ID: US8280859B2
- Status: Granted
- Kind: B2
- Application number: 12/848,486
- Filed: 2010-08-02
- Published: 2010-11-25
- Granted: 2012-10-02
- Earliest claimed: 2008-03-14
- Assignees: International Business Machines Corporation
- Inventors: Matthew J. Anglin; David M. Cannon
- Web page: https://patentgrep.com/patent/US8280859B2

## CPC

- G06F 11/1453: {using de-duplication of the data}
- G06F 16/1756: {based on delta files}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present invention provides for a system and method for assuring integrity of deduplicated data objects stored within a storage system. A data object is copied to secondary storage media, and a digital signature such as a checksum is generated of the data object. Then, deduplication is performed upon the data object and the data object is split into chunks. The chunks are combined when the data object is subsequently accessed, and a signature is generated for the reassembled data object. The reassembled data object is provided if the newly generated signature is identical to the originally generated signature, and otherwise a backup copy of the data object is provided from secondary storage media.

## Claims

### Claim 1

A method in a computer system for assuring integrity of deduplicated data, comprising:
copying a data object within a data system to a backup storage media;
generating an original object signature of the data object;
storing the original object signature of the data object in an index;
deduplicating the data object into data chunks;
assembling the data chunks into a reassembled data object responsive to said data object being accessed by the computer system;
generating a reassembled object signature for the reassembled data object;
comparing the reassembled object signature with the original object signature associated with the data object stored in the index;
providing the reassembled data object if the reassembled object signature matches the original object signature; and
providing the data object stored on the backup storage media if the reassembled object signature of the reassembled data object does not match the original object signature.

### Claim 2 (depends on 1)

The method as in claim 1, wherein the original object signature and reassembled object signature are checksums using a hash function selected from the group consisting of cyclic redundancy check, MD5, SHA-1, SHA-256, SHA-512, and Whirlpool.

### Claim 3 (depends on 1)

The method as in claim 1, wherein deduplicating the data object includes dividing the data object into the data chunks, and for each data chunk:
determining if a previously stored identical copy of the data chunk exists on a primary storage media;
storing the data chunk on the primary storage media in response to determining that the previously stored identical copy of the data chunk does not exist on the primary storage media; and
creating a pointer to the previously stored identical copy of the data chunk on the primary storage media in response to determining that the previously stored identical copy of the data chunk exists on the primary storage media.

### Claim 4 (depends on 3)

The method as in claim 3, wherein the step of determining if the previously stored data chunk is identical to the data chunk includes calculating a hash function value for the data chunk, and comparing said hash function value to an index of data chunk hash function values.

### Claim 5 (depends on 1)

The method as in claim 1, wherein the data object is deduplicated into the data chunks using a Rabin fingerprinting technique.

### Claim 6 (depends on 1)

The method as in claim 1, wherein the backup storage media is tape.

### Claim 7 (depends on 1)

The method as in claim 1, wherein copying the data object to the backup storage media occurs synchronously during ingestion of the data object into the data system.

### Claim 8 (depends on 1)

The method as in claim 1, wherein the generation of the original object signature is performed during ingestion of the data object into the data system.

### Claim 9 (depends on 1)

The method as in claim 1, wherein copying the data object to the backup storage media occurs asynchronously during an operation subsequent to ingestion of the data object into the data system.

### Claim 10 (depends on 1)

The method as in claim 1, wherein generation of the original object signature is performed subsequent to ingestion of the data object into the data system.

### Claim 11 (depends on 1)

The method as in claim 1, wherein the data object is marked as damaged within the data system if the reassembled object signature of the reassembled data object does not match the original object signature stored in the index.

### Claim 12 (depends on 1)

The method as in claim 1, wherein the data object is retrieved from the backup storage media and stored on the primary storage media if the reassembled object signature of the reassembled data object does not match the original object signature.

### Claim 13

A computer program product comprising a computer useable medium having a computer readable program for assuring integrity of deduplicated data, wherein the computer readable program when executed on a computer causes the computer to:
copy a data object within a data system to a backup storage media;
generate an original object signature of the data object;
store the original object signature of the data object in an index;
deduplicate the data object into data chunks;
assemble the data chunks into a reassembled data object responsive to said data object being accessed by the computer system;
generate a reassembled object signature for the reassembled data object;
compare the reassembled object signature with the original object signature associated with the data object stored in the index;
provide the reassembled data object if the reassembled object signature matches the original object signature; and
provide the data object stored on the backup storage media if the reassembled object signature of the reassembled data object does not match the original object signature.

### Claim 14 (depends on 13)

The computer program product as in claim 13, wherein copying the data object to the backup storage media occurs synchronously during ingestion of the data object into the data system.

### Claim 15 (depends on 13)

The computer program product as in claim 13, wherein the generation of the original object signature is performed during ingestion of the data object into the data system.

### Claim 16 (depends on 13)

The computer program product as in claim 13, wherein copying the data object to the backup storage media occurs asynchronously during an operation subsequent to ingestion of the data object into the data system.

### Claim 17 (depends on 13)

The computer program product as in claim 13, wherein generation of the original object signature is performed subsequent to ingestion of the data object into the data system.

### Claim 18

A system, comprising:
At least one processor; and
At least one memory storing instructions operable with the at least one processor for assuring integrity of deduplicated data, the instructions being executed for:
copying a data object within a data system to a backup storage media;
generating an original object signature of the data object;
storing the original object signature of the data object in an index;
deduplicating the data object into data chunks;
assembling the data chunks into a reassembled data object responsive to said data object being accessed by the computer system;
generating a reassembled object signature for the reassembled data object;
comparing the reassembled object signature with the original object signature associated with the data object stored in the index;
providing the reassembled data object if the reassembled object signature matches the original object signature; and
providing the data object stored on the backup storage media if the reassembled object signature of the reassembled data object does not match the original object signature.

### Claim 19 (depends on 18)

The system as in claim 18, wherein copying the data object to the backup storage media occurs synchronously during ingestion of the data object into the data system.

### Claim 20 (depends on 18)

The system as in claim 18, wherein the generation of the original object signature is performed during ingestion of the data object into the data system.

### Claim 21 (depends on 18)

The system as in claim 18, wherein copying the data object to the backup storage media occurs asynchronously during an operation subsequent to ingestion of the data object into the data system.

### Claim 22 (depends on 18)

The system as in claim 18, wherein generation of the original object signature is performed subsequent to ingestion of the data object into the data system.

### Claim 23

A method in a computer system for assuring integrity of deduplicated data, comprising:
generating an original object signature of a data object;
storing the original object signature of the data object in an index;
deduplicating the data object into data chunks;
assembling the data chunks into a reassembled data object responsive to said data object being accessed by the computer system;
generating a reassembled object signature for the reassembled data object;
comparing the reassembled object signature with the original object signature associated with the data object stored in the index; and
providing the reassembled data object if the reassembled object signature matches the original object signature.

### Claim 24 (depends on 23)

The method as in claim 23, further comprising providing notification if the reassembled object signature does not match the original object signature.
