Adaptive compression and transmission for big data migration

A computer program product comprising a non-transitory computer readable storage medium having a set of instructions stored therein which, when executed by a processor, causes the processor to compress adaptively and transmit big data by:

• identifying an information entropy of a first data block having a block size;
• receiving a real-time resource status of a system, wherein the system includes a first computer, a second computer, and a communication channel having a bandwidth between the first computer and the second computer;
• determining a first preferred compression method to compress the first data block based at least in part on the information entropy and the real-time resource status;
• generating a compressed first data block according to the first preferred compression method;
• transferring the compressed first data block over the communication channel from the first computer to the second computer;
• and
• decompressing the compressed first data block upon arriving at the second computer.

A computer system comprising:

• a processor set;
• and
• a computer readable storage medium;
• wherein:
• the processor set is structured, located, connected, and/or programmed to run program instructions stored on the computer readable storage medium;
• and
• the program instructions which, when executed by the processor set, cause the processor set to compress adaptively and transmit big data by:
• identifying an information entropy of a first data block having a block size;
• receiving a real-time resource status of a system, wherein the system includes a first computer, a second computer, and a communication channel having a bandwidth between the first computer and the second computer;
• determining a first preferred compression method to compress the first data block based at least in part on the information entropy and the real-time resource status;
• generating a compressed first data block according to the first preferred compression method;
• transferring the compressed first data block over the communication channel from the first computer to the second computer;
• and
• decompressing the compressed first data block upon arriving at the second computer.