Expansion cartridge for deduplication of data chunks in client devices interspersed in networked environments

An expansion cartridge (200) attachable, externally, to a client device (100) carrying electronic data files to be transferred, wherein the expansion cartridge (200) is characterized by—

• a file management component (220) configured to generate a preliminary set of metadata for an electronic data file to be transferred,
• a chunk management component (240) configured to divide the electronic data file to be transferred to generate data chunks and generate a final set of metadata for each data chunk generated thereof,
• a storage component (260) configured to compare the data chunks with the final sets of metadata received thereof with the data chunks with final sets of metadata already stored at one or more discrete tuples in a client side data historian (125) in the client device (100), and discard or store the data chunks with the final sets of metadata generated thereof, based on the comparing thereof, and
• a mirroring component (280);
• and
• wherein, the expansion cartridge (200) on being attached with the client device (100) interfaces with the client side data historian (125) and a client side processor (150) in the client device (100) using interfacing options, including without limitation, Small Computer System Interfaces (SCSI), Fibre Channel (FC) Interface, Ethernet Interface, Advanced Technology Attachment (ATA) Interface or a combination thereof,
• wherein the mirroring component (280) receives a request from a second client device in a networked environment to transfer the electronic data file to be transferred, and thereafter—
• connects with the client side data historian (125), and determines a discrete tuple therein where the data chunks with final sets of metadata corresponding to the electronic data file requested thereof, are stored;
• creates a copy of the data chunks with the final sets of metadata stored at the discrete tuple determined thereof;
• and
• transmits the copy created thereof to the second client device in the networked environment wherefrom the request of the data chunks with final sets of metadata is made.

A method for deduplicating, at a client device (100), data chunks of electronic data files to be transferred, using an expansion cartridge (200), (300) wherein the method (300) comprises the steps of—

• determining a Unique Identification String for an electronic data file to be transferred (310);
• generating a preliminary set of metadata for the electronic data file to be transferred (320);
• dividing the electronic data file to be transferred for generating data chunks (330);
• generating a final set of metadata for each data chunk generated thereof (340);
• and
• comparing the data chunks with the final sets of metadata generated thereof with the data chunks with final sets of metadata already stored at one or more discrete tuples in a client side data historian (125), and, discarding or storing the data chunks with the final sets of metadata generated thereof, based on the comparing thereof,
• wherein generating the preliminary set of metadata for the electronic data file to be transferred (320), consists of—
• generating “SRC”, that is, a MAC/Network address of the client device (100) where the electronic data file to be transferred is present (321);
• generating “DSTN”, that is, a MAC/Network address of a client device (100) requesting receiving of the electronic data file to be transferred (322);
• generating “UID”, that is, the Unique Identification String for the electronic data file to be transferred (323);
• generating “FNAME”, that is, a name of the electronic data file to be transferred (324);
• generating “FSIZE”, that is, a size of the electronic data file to be transferred (325);
• and
• generating “FFORMAT”, that is, a format of the electronic data file to be transferred (326).

A method for deduplicating, at a client device (100), data chunks of electronic data files to be transferred, using an expansion cartridge (200), (300) wherein the method (300) comprises the steps of—

• determining a Unique Identification String for an electronic data file to be transferred (310);
• generating a preliminary set of metadata for the electronic data file to be transferred (320);
• dividing the electronic data file to be transferred for generating data chunks (330);
• generating a final set of metadata for each data chunk generated thereof (340);
• and
• comparing the data chunks with the final sets of metadata generated thereof with the data chunks with final sets of metadata already stored at one or more discrete tuples in a client side data historian (125), and, discarding or storing the data chunks with the final sets of metadata generated thereof, based on the comparing thereof (350),
• wherein after the comparing the data chunks with the final sets of metadata generated thereof with the data chunks with final sets of metadata already stored at the one or more discrete tuples in the client side data historian (125), and, discarding or storing the data chunks with the final sets of metadata generated thereof based on the comparing thereof (350), the method (300) may upon receiving a request from a second client devices in a networked environment to transfer the electronic data file to be transferred, may trigger additional sub-steps of—
• connecting with the client side data historian (125), and determining the discrete tuple therein where the data chunks with the final sets of metadata corresponding to the electronic data file requested thereof, are stored;
• creating a copy of the data chunks with the final sets of metadata stored at the discrete tuple determined thereof;
• and
• transmitting the copy created thereof to the second client device in the networked environment wherefrom the request of the data chunks with final sets of metadata is made.