Buffering and compressing data sets

A computer program product including one or more computer readable storage mediums collectively storing program instructions that are executable by a processor or programmable circuitry to cause the processor or programmable circuitry to perform operations comprising:

• preparing at least one buffer including a plurality of compression windows, each compression window having a data region for storing data and a statistics region for storing statistics of data stored in the data region;
• receiving a data set;
• writing the received data set into the data region in a first compression window among the plurality of compression windows included in a first buffer among the at least one buffer;
• updating statistics of the statistics region in the first compression window based on the received data set;
• compressing the data set from the data region of the first compression window based on the statistics in the statistics region of the first compression window;
• and
• sending the compressed data set to the data region of the first compression window to replace the received data set.

A buffering apparatus comprising:

• a processor or a programmable circuitry;
• and
• one or more computer readable mediums collectively including instructions that, when executed by the processor or the programmable circuitry, cause the processor or the programmable circuitry to:
• prepare at least one buffer including a plurality of compression windows, each compression window having a data region for storing data and a statistics region for storing statistics of data stored in the data region,
• receive a data set,
• write the received data set into the data region in a first compression window among the plurality of compression windows included in a first buffer among the at least one buffer,
• update statistics of the statistics region in the first compression window based on the received data set,
• compress the data set from the data region of the first compression window based on the statistics in the statistics region of the first compression window, and
• send the compressed data set to the data region of the first compression window to replace the received data set.