# US 2012/0254207 A1 · File identification management and tracking

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254207 A1
- Document ID: US20120254207A1
- Status: Published application
- Kind: A1
- Application number: 13/076,296
- Filed: 2011-03-30
- Published: 2012-10-04
- Earliest claimed: 2011-03-30
- Assignees: Splunk Inc.
- Inventors: Amritpal Singh Bath; Mitchell Neuman Blank, JR.; Vishal Patel; Stephen Phillip Sorkin
- Web page: https://patentgrep.com/patent/US20120254207A1

## CPC

- G06F 16/1734: {Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs}
- G06F 16/174: Redundancy elimination performed by the file system (error detection or correction of the data by redundancy in operations G06F11/14)
- G06F 16/20: of structured data, e.g. relational data
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Embodiments are directed towards managing and tracking item identification of a plurality of items to determine if an item is a new or existing item, where an existing item has been previously processed. In some embodiments, two or more item identifiers may be generated. In one embodiment, generating the two or more item identifiers may include analyzing the item using a small item size characteristic, a compressed item, or for an identifier collision. The two or more item identifiers may be employed to determine if the item is a new or existing item. In one embodiment, the two or more item identifiers may be compared to a record about an existing item to determine if the item is a new or existing item. If the item is an existing item, then the item may be further processed to determine if the existing item has actually changed.

## Claims

### Claim 1

A network device, comprising:
a data store configured to include a record about an existing item that has been previously processed, wherein the record includes two or more item identifiers about the existing item;
a transceiver for receiving an item over a network; and
a processor for enabling actions, comprising:
generating two or more item identifiers about the item, wherein each of the two or more item identifiers is generated from at least some different data associated with the item, and wherein at least one of the generated two or more item identifiers is based on a predetermined amount of content at an end portion of the item;
determining whether the item is a new item based on a comparison of the generated two or more item identifiers and the two or more item identifiers in the record; and
when it is determined that the item is a new item based on the comparison, storing an other record about the new item in the data store, wherein the other record includes at least the generated two or more item identifiers about the item.

### Claim 2 (depends on 1)

The network device of claim 1, wherein the processor further enables actions, comprising:
when it is determined that the item is an existing item based on a match of the generated two or more item identifiers and the two or more item identifiers in the record, processing the item to determine if there is an actual change to the item based on a comparison of the item and the record; and
when it is determined that there is an actual change, storing the actual change in the record.

### Claim 3 (depends on 1)

The network device of claim 1, wherein generating the two or more item identifiers, further including:
based on a determination that an item size of the item is less than a defined amount of data for an item identifier, performing actions, including:
generating a first item identifier based on a name of the item;
obtaining a stored end of item pointer based on the first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the item; and
generating a second item identifier based on the predetermined amount of content at the end portion of the item, wherein the predetermined amount of content is based on the stored end of item pointer, and wherein the end portion is associated with the stored end of item pointer.

### Claim 4 (depends on 1)

The network device of claim 1, wherein generating the two or more item identifiers, further including:
based on a determination that the item is compressed, performing actions, including:
decompressing a defined amount of content at a beginning of the item;
generating a first item identifier based on the decompressed content;
obtaining a stored end of item pointer based on the first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the item;
decompressing additional content of the item up to the stored end of item pointer; and
generating a second item identifier from the additional decompressed content, such that the second item identifier is based on the predetermined amount of content at the end portion of the item, wherein the end portion is associated with the stored end of item pointer.

### Claim 5 (depends on 1)

The network device of claim 1, wherein generating the two or more item identifiers, further including:
generating a first item identifier based on a defined amount of content at a beginning of the item;
determining whether the item has an identifier collision, at least in part based on two or more items having a same first item identifier; and
based on the determination that the item has an identifier collision, performing actions, including:
obtaining a stored end of item pointer based on the first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the item;
generating a second item identifier based on the predetermined amount of content at the end portion of the item, wherein the end portion is associated with the stored end of item pointer; and
generating a third item identifier based on a name of the item.

### Claim 6 (depends on 1)

The network device of claim 1, wherein generating the two or more item identifiers further includes employing a cyclic redundancy check on data associated with the item.

### Claim 7 (depends on 1)

The network device of claim 1, wherein the processor further enables actions, comprising:
processing the item to a current end of the item;
obtaining a stored end of item pointer from the record about the existing item that matches the item;
determining whether the item is completely written to based on a comparison of the current end of the item and the stored end of item pointer; and
when it is determined the item is completely written to, returning a done command to indicate that the item is completely written to.

### Claim 8

A method operating on one or more network devices, the method implemented as one or more computer executable instructions for performing actions, comprising:
storing a record about an existing item that has been previously processed, wherein the record includes two or more item identifiers about the existing item;
receiving an item;
generating two or more item identifiers about the item, wherein each of the two or more item identifiers is generated from at least some different data associated with the item, and wherein at least one of the generated two or more item identifiers is based on a predetermined amount of content at an end portion of the item;
determining whether the item is a new item based on a comparison of the generated two or more item identifiers and the two or more item identifiers in the record; and
when it is determined that the item is a new item based on the comparison, storing an other record about the new item in the data store, wherein the other record includes at least the generated two or more item identifiers about the item.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
when it is determined that the item is an existing item based on a match of the generated two or more item identifiers and the two or more item identifiers in the record, processing the item to determine if there is an actual change to the item based on a comparison of the item and the record; and
when it is determined that there is an actual change, storing the actual change in the record.

### Claim 10 (depends on 8)

The method of claim 8, wherein generating the two or more item identifiers, further including:
based on a determination that an item size of the item is less than a defined amount of data for an item identifier, performing actions, including:
generating a first item identifier based on a name of the item;
obtaining a stored end of item pointer based on the first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the item; and
generating a second item identifier based on the predetermined amount of content at the end portion of the item, wherein the predetermined amount of content is based on the stored end of item pointer, and wherein the end portion is associated with the stored end of item pointer.

### Claim 11 (depends on 8)

The method of claim 8, wherein generating the two or more item identifiers, further including:
based on a determination that the item is compressed, performing actions, including:
decompressing a defined amount of content at a beginning of the item;
generating a first item identifier based on the decompressed content;
obtaining a stored end of item pointer based on the first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the item;
decompressing additional content of the item up to the stored end of item pointer; and
generating a second item identifier from the additional decompressed content, such that the second item identifier is based on the predetermined amount of content at the end portion of the item, wherein the end portion is associated with the stored end of item pointer.

### Claim 12 (depends on 8)

The method of claim 8, wherein generating the two or more item identifiers, further including:
generating a first item identifier based on a defined amount of content at a beginning of the item;
determining whether the item has an identifier collision, at least in part based on two or more items have a same first item identifier; and
based on the determination that the item has an identifier collision, performing actions, including:
obtaining a stored end of item pointer based on the first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the item;
generating a second item identifier based on the predetermined amount of content at the end portion of the item, wherein the end portion is associated with the stored end of item pointer; and
generating a third item identifier based on a name of the item.

### Claim 13

A system, comprising:
a storage device for storing a record about a existing item that has been previously processed, wherein the record includes two or more item identifiers about the existing item; and
one or more network devices that are configured to receive an item and to perform actions, including:
generating two or more item identifiers about the item, wherein each of the two or more item identifiers is generated from at least some different data associated with the item, and wherein at least one of the generated two or more item identifiers is based on a predetermined amount of content at an end portion of the item;
determining whether the item is a new item based on a comparison of the generated two or more item identifiers and the two or more item identifiers in the record; and
when it is determined that the item is a new item based on the comparison, storing an other record about the new item in the storage device, wherein the other record includes at least the generated two or more item identifiers about the item.

### Claim 14 (depends on 13)

The system of claim 13, wherein the one or more network devices perform actions, the actions further comprising:
when it is determined that the item is an existing item based on a match of the generated two or more item identifiers and the two or more item identifiers in the record, processing the item to determine if there is an actual change to the item based on a comparison of the item and the record; and
when it is determined that there is an actual change, storing the actual change in the record.

### Claim 15 (depends on 13)

The system of claim 13, wherein generating the two or more item identifiers, further including:
based on a determination that an item size of the item is less than a defined amount of data for an item identifier, performing actions, including:
generating a first item identifier based on a name of the item;
obtaining a stored end of item pointer based on the first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the item; and
generating a second item identifier based on the predetermined amount of content at the end portion of the item, wherein the predetermined amount of content is based on the stored end of item pointer, and wherein the end portion is associated with the stored end of item pointer.

### Claim 16 (depends on 13)

The system of claim 13, wherein generating the two or more item identifiers, further including:
based on a determination that the item is compressed, performing actions, including:
decompressing a defined amount of content at a beginning of the item;
generating a first item identifier based on the decompressed content;
obtaining a stored end of item pointer based on the first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the item;
decompressing additional content of the item up to the stored end of item pointer; and
generating a second item identifier from the additional decompressed content, such that the second item identifier is based on the predetermined amount of content at the end portion of the item, wherein the end portion is associated with the stored end of item pointer.

### Claim 17 (depends on 13)

The system of claim 13, wherein generating the two or more item identifiers, further including:
generating a first item identifier based on a defined amount of content at a beginning of the item;
determining whether the item has an identifier collision, at least in part based on two or more items have a same first item identifier; and
based on the determination that the item has an identifier collision, performing actions, including:
obtaining a stored end of item pointer based on the first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the item;
generating a second item identifier based on the predetermined amount of content at the end portion of the item, wherein the end portion is associated with the stored end of item pointer; and
generating a third item identifier based on a name of the item.

### Claim 18

A computer-readable storage device that includes data and instructions, that when installed within on a computer device causes the computer device to perform actions, comprising:
storing a record about an existing item that has been previously processed, wherein the record includes two or more item identifiers about the existing item;
receiving an item;
generating two or more item identifiers about the item, wherein each of the two or more item identifiers is generated from at least some different data associated with the item, and wherein at least one of the generated two or more item identifiers is based on a predetermined amount of content at an end portion of the item;
determining whether the item is a new item based on a comparison of the generated two or more item identifiers and the two or more item identifiers in the record; and
when it is determined that the item is a new item based on the comparison, storing an other record about the new item in the data store, wherein the other record includes at least the generated two or more item identifiers about the item.

### Claim 19 (depends on 18)

The computer-readable storage device of claim 18, wherein the instructions perform actions, further comprising:
when it is determined that the item is an existing item based on a match of the generated two or more item identifiers and the two or more item identifiers in the record, processing the item to determine if there is an actual change to the item based on a comparison of the item and the record; and
when it is determined that there is an actual change, storing the actual change in the record.

### Claim 20 (depends on 18)

The computer-readable storage device of claim 18, wherein generating the two or more item identifiers, further including:
based on a determination that an item size of the item is less than a defined amount of data for an item identifier, performing actions, including:
generating a first item identifier based on a name of the item;
obtaining a stored end of item pointer based on the first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the item; and
generating a second item identifier based on the predetermined amount of content at the end portion of the item, wherein the predetermined amount of content is based on the stored end of item pointer, and wherein the end portion is associated with the stored end of item pointer.

### Claim 21 (depends on 18)

The computer-readable storage device of claim 18, wherein generating the two or more item identifiers, further including:
based on a determination that the item is compressed, performing actions, including:
decompressing a defined amount of content at a beginning of the item;
generating a first item identifier based on the decompressed content;
obtaining a stored end of item pointer based on the first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the item;
decompressing additional content of the item up to the stored end of item pointer; and
generating a second item identifier from the additional decompressed content, such that the second item identifier is based on the predetermined amount of content at the end portion of the item, wherein the end portion is associated with the stored end of item pointer.

### Claim 22 (depends on 18)

The computer-readable storage device of claim 18, wherein generating the two or more item identifiers, further including:
generating a first item identifier based on a defined amount of content at a beginning of the item;
determining whether the item has an identifier collision, at least in part based on two or more items have a same first item identifier; and
based on the determination that the item has an identifier collision, performing actions, including:
obtaining a stored end of item pointer based on the first item identifier from the record, wherein the stored end of item pointer is a reference to an end of the item from previously processing the item;
generating a second item identifier based on the predetermined amount of content at the end portion of the item, wherein the end portion is associated with the stored end of item pointer; and
generating a third item identifier based on a name of the item.
