Batch compression management of messages

A computer program product for batch compression management of messages, comprising:

• a computer readable storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method comprising:
• intercepting, by one or more processors, in middleware between a first distributed system and a second distributed system, a message comprising a payload originating from the first distributed system being sent to a batch for transmission to the second distributed system;
• assigning, by the one or more processors, based on the payload of the message, the payload comprising a message schema, the message to a batch pool, wherein multiple batch pools are provided as sub-sets of the batch, and wherein assigning the message to the batch pool is based on a similarity of properties of the message with other messages and determined by looking up message properties in a batch pool mapping database, wherein the properties of each message of the message and the other messages comprise a message schema, wherein the similarity of properties of the message with other messages comprise a similarity of the message schema of the message to message schemas of the other messages, based on the message schema of the message and the message schemas of the other messages comprising common extensible markup language (XML) tags and common XML elements that comprise a pre-defined threshold portion of the payload of the message and payloads of the other messages;
• adding, by the one or more processors, the message to the batch pool or creating a new batch pool for the message;
• performing, by the one or more processors, a customized compression on a selected batch pool of messages using a dictionary of properties common to at least some of the messages in the batch pool, wherein the customized compression is an optimized compression that minimizes a number of entries utilized in the dictionary and reduces overhead in the one or more processors, based on the at least some of the messages in the selected pool of messages sharing the dictionary of common properties;
• and
• transmitting, by the one or more processors, the compressed batch pool over an input/output channel to the second distributed system.

A computer system for batch compression management of messages, comprising:

• a memory;
• and
• a processing device comprising one or more processors in communication with the memory, wherein the computer system is configured to perform a method, said method comprising:
• intercepting, by the one or more processors, in middleware between a first distributed system and a second distributed system, a message comprising a payload originating from the first distributed system being sent to a batch for transmission to the second distributed system;
• assigning, by the one or more processors, based on the payload of the message, the payload comprising a message schema, the message to a batch pool, wherein multiple batch pools are provided as sub-sets of the batch, and wherein assigning the message to the batch pool is based on a similarity of properties of the message with other messages and determined by looking up message properties in a batch pool mapping database, wherein the properties of each message of the message and the other messages comprise a message schema, wherein the similarity of properties of the message with other messages comprise a similarity of the message schema of the message to message schemas of the other messages, based on the message schema of the message and the message schemas of the other messages comprising common extensible markup language (XML) tags and common XML elements that comprise a pre-defined threshold portion of the payload of the message and payloads of the other messages;
• adding, by the one or more processors, the message to the batch pool or creating a new batch pool for the message;
• performing, by the one or more processors, a customized compression on a selected batch pool of messages using a dictionary of properties common to at least some of the messages in the batch pool, wherein the customized compression is an optimized compression that minimizes a number of entries utilized in the dictionary and reduces overhead in the processing device, based on the at least some of the messages in the selected pool of messages sharing the dictionary of common properties;
• and
• transmitting, by the one or more processors, the compressed batch pool over an input/output channel to the second distributed system.