Packet deduplication

A device comprising:

• an interface configured to enable network communications;
• a memory;
• and
• one or more processors coupled to the interface and the memory, and configured to:
• receive a packet;
• hash elements of the packet to obtain a packet partial signature;
• append, to the packet partial signature, unhashed packet information to obtain a concatenated string of the packet partial signature and the unhashed packet information;
• generate an action data value by hashing the concatenated string of the packet partial signature and the unhashed packet information;
• access a hash store location in a hash store using the action data value as an address;
• determine, based on data stored at the hash store location, whether the packet is a duplicate of a previously-received packet;
• and
• based on whether the packet is a duplicate of a previously-received packet, one of allow and prevent one of the packet and a copy of the packet to reach a downstream network node.

One or more non-transitory computer readable storage media encoded with instructions that, when executed by a processor, cause the processor to:

• receive a packet;
• hash elements of the packet to obtain a packet partial signature;
• append, to the packet partial signature, unhashed packet information to obtain a concatenated string of the packet partial signature and the unhashed packet information;
• generate an action data value by hashing the concatenated string of the packet partial signature and the unhashed packet information;
• access a hash store location in a hash store using the action data value as an address;
• determine, based on data stored at the hash store location, whether the packet is a duplicate of a previously-received packet;
• and
• based on whether the packet is a duplicate of a previously-received packet, one of allow and prevent one of the packet and a copy of the packet to reach a downstream network node.