Back to results
US 8,543,551 B2Granted
Collaborative, distributed, data de-duplication
OwnerJeffrey Vincent Tofanoinventor
Life of this patent
Estimating the term…
Abstract
Example apparatus, methods, and computers participate in collaborative, distributed, data de-duplication. One example method includes initializing a layered parser in a first node in a collaborative distributed data de-duplication (CDDD) topology with a first set of de-duplication control parameters. After transmitting some information to another node in the CDDD topology, the method includes selectively reconfiguring the layered parser in response to feedback acquired from the second node in the CDDD topology. The feedback concerns the data provided by the layered parser.
Claims19
A method, comprising:
- upon determining that a first node configured with a parameterized reactive agent is going to participate in a collaborative, distributed data de-duplication operation in a collaborative, distributed, data de-duplication (CDDD) topology,
- controlling the first node, in accordance with a set of parameters associated with the parameterized reactive agent, to create a de-duplication negotiation packet (DNPkt) associated with processing raw data available to the first node;
- controlling the first node to transmit the DNPkt to a second node in the CDDD topology;
- receiving, from the second node, a reactive control packet (RCPkt) responsive to the DNPkt;
- and
- selectively reconfiguring the parameterized reactive agent by modifying the set of parameters in response to information in the RCPkt.
3 more elements
An apparatus, comprising:
- a data store to store:
- raw data to be de-duplicated as part of a collaborative, distributed process involving two or more apparatus;
- processed data de-duplicated as part of the collaborative, distributed process;
- indexing data for identifying and retrieving the processed data;
- and
- configuration information for controlling how the apparatus performs its portion of the collaborative, distributed process;
- a processor;
- a memory;
- and
- an interface to connect the processor, the memory, and a set of logics, the set of logics comprising:
- a chunk logic configured to participate in the collaborative, distributed process by creating a chunk of data from the raw data, where the chunk of data is a subset of the raw data;
- a hash logic configured to participate in the collaborative, distributed process by computing a hash for the chunk of data;
- an index logic configured to participate in the collaborative, distributed process by selectively storing the chunk of data in the data store and by manipulating the indexing data based, at least in part, on the hash;
- a chunk transmission logic configured to transmit the chunk to a second apparatus involved in the collaborative, distributed process;
- a hash transmission logic configured to transmit the hash to the second apparatus;
- and
- a control logic configured to control the chunk logic, the hash logic, the index logic, the chunk transmission logic, and the hash transmission logic based on the configuration information and on feedback data from the second apparatus.
14 more elements
Dependencies are inferred from the claim text.