Data de-duplication in a distributed network

A system for de-duplication of data in a distributed network, comprising:

• a processor;
• and
• a memory coupled to the processor, wherein the memory stores computer code that, when executed by the processor, cause the processor to:
• receive, by a first de-duplication manager (DDM) in the distributed network, at least a unique identification (ID) of the data and a network address of a first storage medium in which the data is stored,
• locate one or more storage media in the distributed network in which the data is stored using an association of the unique ID of the data and one or more physical addresses where the data is stored, wherein a logical address of the data is associated with network addresses of the one or more storage media;
• determine, via the association, if there is more than a predetermined threshold number of copies of the data, and
• if there is more than the predetermined threshold number of copies of the data:
• select one or more copies of the data for removal, and
• remove the selected one or more copies of the data from a second storage medium selected from among the one or more storage media, wherein selecting the one or more copies comprises selecting the one or more copies of the data that are furthest from a client that frequently accesses the data.

A physical computer storage memory comprising a computer program product method for de-duplication of data in a distributed network, the physical computer storage memory comprising:

• computer code for receiving, by a first de-duplication manager (DDM) in the distributed network, at least a unique identification (ID) of the data and a network address of a first storage medium in which the data is stored;
• computer code for locating one or more storage media in the distributed network in which the data is stored using an association of the unique ID of the data and one or more physical addresses where the data is stored, wherein a logical address of the data is associated with network addresses of the one or more storage media;
• computer code for determining, via the association, if there is more than a predetermined threshold number of copies of the data;
• and
• if there is more than the predetermined threshold number of copies of the data:
• computer code for selecting one or more copies of the data for removal, and
• computer code for removing the selected one or more copies of the data from a second storage medium selected from among the one or more storage media, wherein selecting the one or more copies comprises selecting the one or more copies of the data that are furthest from a client that frequently accesses the data.