Application layer payload optimization

A system, comprising:

• a memory;
• and
• a processor operatively coupled to the memory, the processor being configured to perform the operations of:
• obtaining an outbound message, the outbound message being an application-layer message, the outbound message being generated by a first application that is executed by the processor;
• generating a plurality of first fingerprints based on the outbound message, each of the first fingerprints being generated based on a different portion of the outbound message;
• detecting, based on the plurality of first fingerprints, whether a first cached message is stored in the memory that matches the outbound message;
• when the first cached message is stored in the memory, including an identifier of the first cached message in the outbound message, replacing a first region of a payload of the outbound message with a first token, the first region of the payload of the outbound message including a sequence of bits that is also found the first cached message, and transmitting the outbound message to a remote device;
• and
• when the first cached message is not stored in the memory, transmitting the outbound message to the remote device, the outbound message being transmitted without replacing any portion of the payload of the outbound message with a token,
• wherein the plurality of first fingerprints is generated by a deduplicator that is integrated into an application layer of a protocol stack that is executed by the processor, and
• wherein detecting whether the first cached message is stored in the memory includes:
• (i) identifying a cache structure that stores only messages that are destined for a second application for which the outbound message is destined, the cache structure being part of a plurality of cache structures that are stored in the memory, each of the plurality of cache structures being dedicated to storing data destined for a different application, and (ii) performing a search of the identified cache structure to determine whether the cache structure includes a cached message that is associated with a predetermined number of second fingerprints that match respective ones of the plurality of first fingerprints.

A non-transitory computer-readable medium that is configured to store one or more processor-executable instructions, which, when executed by at least one processor, further cause the at least one processor to perform the operations of:

• obtaining an outbound message, the outbound message being an application-layer message, the outbound message being generated by a first application that is executed by the processor;
• generating a plurality of first fingerprints based on the outbound message, each of the first fingerprints being generated based on a different portion of the outbound message;
• detecting, based on the plurality of first fingerprints, whether a first cached message is stored in a memory that matches the outbound message;
• when the first cached message is stored in the memory, including an identifier of the first cached message in the outbound message, replacing a first region of a payload of the outbound message with a first token, the first region of the payload of the outbound message including a sequence of bits that is also found the first cached message, and transmitting the outbound message to a remote device;
• and
• when the first cached message is not stored in the memory, transmitting the outbound message to the remote device, the outbound message being transmitted without replacing any portion of the payload of the outbound message with a token,
• wherein the plurality of first fingerprints is generated by a deduplicator that is integrated into an application layer of a protocol stack that is executed by the at least one processor, and
• wherein detecting whether the first cached message is stored in the memory includes:
• (i) identifying a cache structure that stores only messages that are destined for a second application for which the outbound message is destined, the cache structure being part of a plurality of cache structures that are stored in the memory, each of the plurality of cache structures being dedicated to storing data destined for a different application, and (ii) performing a search of the identified cache structure to determine whether the cache structure includes a cached message that is associated with a predetermined number of second fingerprints that match respective ones of the plurality of first fingerprints.