Shared data de-duplication method and system

A system comprising:

• one or more processors;
• and
• a non-transitory computer-readable medium storing instructions executable by the one or more processors to perform operations comprising:
• identifying a first acceleration node included in a computer network comprising two or more acceleration nodes, an acceleration node to accelerate transmission of resources between a client computer system and a server computer system connected through the acceleration node, the first acceleration node including a first dictionary of data items and data identifiers, each data identifier identifying a corresponding data item, and wherein an acceleration node is configured to provide data identifiers to other acceleration nodes and to identify a data item based on a data identifier received from another acceleration node;
• receiving, at the first acceleration node and from a second acceleration node, a data item;
• including the data item in the first dictionary;
• and
• providing the received data item, a data identifier identifying the received data item, or both to a third acceleration node of the computer network, wherein the data identifier is determined at the first acceleration node or obtained from another acceleration node.

A non-transitory computer readable medium storing instructions thereon which when executed by a processor cause the processor to:

• identify a first acceleration node included in a computer network comprising two or more acceleration nodes, an acceleration node to accelerate transmission of resources between a client computer system and a server computer system connected through the acceleration node, the first acceleration node including a first dictionary of data items and data identifiers, each data identifier identifying a corresponding data item, and wherein an acceleration node is configured to provide data identifiers to other acceleration nodes and to identify a data item based on a data identifier received from another acceleration node;
• receive, at the first acceleration node and from a second acceleration node, a data item;
• include the data item in the first dictionary;
• and
• provide the received data item, a data identifier identifying the received data item, or both to a third acceleration node of the computer network, wherein the data identifier is determined at the first acceleration node or obtained from another acceleration node.