# US 8,280,857 B2 · Method for indexed-field based difference detection and correction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,280,857 B2
- Document ID: US8280857B2
- Status: Granted
- Kind: B2
- Application number: 12/491,539
- Filed: 2009-06-25
- Published: 2009-10-15
- Granted: 2012-10-02
- Earliest claimed: 2006-06-26
- Assignees: AT&T Intellectual Property II, L.P.
- Inventors: Arthur L. Zaifman
- Web page: https://patentgrep.com/patent/US8280857B2

## CPC

- G06F 16/174: Redundancy elimination performed by the file system (error detection or correction of the data by redundancy in operations G06F11/14)
- G06F 16/10: File systems; File servers
- Y10S 707/99933: Query processing, i.e. searching
- Y10S 707/99934: Query formulation, input preparation, or translation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y10S: TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS

## Abstract

A method and system for indexed field based difference detection and correction. A data feed file is partitioned into a plurality of subsets based on an indexed field of the data feed file. A redundancy check value is calculated for each of the subsets, and the redundancy check value is compared to a database file which corresponds to each subset. If the redundancy check values do not match for a subset and a corresponding database file, a difference is detected between the subset and the corresponding database file and the corresponding database file is replaced by the subset.

## Claims

### Claim 1

A method comprising:
partitioning a data feed file into a plurality of subsets based on an indexed field of the data feed file;
calculating a redundancy check value for each of the plurality of subsets;
comparing the redundancy check value of each of the plurality of subsets with a redundancy check value of a corresponding stored database file; and
if the redundancy check value for a subset is not equal to the redundancy check value of the corresponding stored database file, replacing the corresponding stored database file with said subset.

### Claim 2 (depends on 1)

The method of claim 1, wherein said partitioning step comprises:
grouping records of said data feed file into a subset for each unique value of said indexed field.

### Claim 3 (depends on 1)

The method of claim 1, wherein said partitioning step comprises:
storing a filename for each of the plurality of subsets, said filename comprising a source name of said data feed file, a source timestamp of said data feed file, a field name of said indexed field, and a field value of said indexed field.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
storing the redundancy check value of each of the plurality of subsets and associating the redundancy check value with the filename for each of the plurality of subsets.

### Claim 5 (depends on 3)

The method of claim 3, wherein said comparing step comprises:
searching a database table for a record representing the corresponding stored database file for each of the plurality of subsets based on the filename of each of the plurality of subsets; and
comparing the redundancy check value appended to the filename of each of the plurality of subsets with a redundancy check value stored in a redundancy check field of the record representing the corresponding stored database file for each of the plurality of subsets.

### Claim 6 (depends on 5)

The method of claim 5, wherein a record representing a stored database file includes a source name field, a source timestamp field, a field name field, a field value field, and a redundancy check field.

### Claim 7 (depends on 6)

The method of claim 6, wherein said replacing step comprises:
generating a query to extract the source timestamp, the field name, and the field value of said corresponding stored database file from the source timestamp field, the field name field, and the redundancy check field of the record representing said corresponding stored database file in said database table;
deleting said corresponding stored database file using the extracted source timestamp, field name, and field value; and
loading said subset to be stored as said corresponding stored database file.

### Claim 8 (depends on 5)

The method of claim 5, further comprising:
when a corresponding stored database file is replaced by one of the plurality of subsets, updating the record representing the corresponding stored database file in said database table.

### Claim 9 (depends on 1)

The method of claim 1, wherein said replacing step comprises:
deleting said corresponding stored database file from a database; and
loading said one of the plurality of subsets to the database to be stored as said corresponding stored database file.

### Claim 10 (depends on 1)

The method of claim 1, wherein said calculating step comprises:
calculating a cyclic redundancy check (CRC) value as the redundancy check value for each of the plurality of subsets.

### Claim 11 (depends on 1)

The method of claim 1, wherein said data feed file comprises records containing network traffic data.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
receiving said data feed file from a network router.
