Parallel compression for dictionary-based sequential coders
AssigneeRed Hat, Inc.
InventorJind{hacek over (r)}ich Nový
Life of this patent
Estimating the term…
Abstract
Dictionary-based sequential compression is performed in parallel on input data using multiple cores of a computer system. The compression can be performed by first determining a dictionary size for data compression, followed by determining a block size for partitioning the input data. The block size is greater than the dictionary size. The multiple cores of the computer system then execute multiple threads in parallel, with each thread compressing one block of the input data according to a dictionary-based sequential compression scheme.
Claims19
A method, implemented by a computer system programmed to perform the following, comprising:
- determining, by the computer system, a dictionary size for data compression based on a received compression level;
- determining, by the computer system, a block size greater than the dictionary size for partitioning input data;
- and
- executing multiple threads in parallel using multiple cores of the computer system, each thread compressing one block of the input data according to a dictionary-based sequential compression scheme.
A system comprising:
- data storage to store input data;
- and
- a computer system coupled to the data storage, the computer system comprising:
- a compression manager to determine a dictionary size based on a received compression level and to determine a block size that is greater than the dictionary size for partitioning input data;
- and
- a plurality of cores to execute multiple threads in parallel, each thread to compress one block of the input data according to a dictionary-based sequential compression scheme to generate the compressed data.
A non-transitory computer readable storage medium including instructions that, when executed by a processing system, cause the processing system to perform a method comprising:
- determining a dictionary size for data compression based on a received compression level;
- determining a block size greater than the dictionary size for partitioning input data;
- and
- executing multiple threads in parallel using multiple cores of a computer system, each thread compressing one block of the input data according to a dictionary-based sequential compression scheme.
A method, implemented by a client machine programmed to perform the following, the method comprising:
- partitioning, by the client machine, compressed data into a plurality of data blocks;
- determining whether to decompress the plurality of data blocks sequentially or in parallel;
- and
- decompressing the data blocks accordingly by the client machine using a dictionary-based sequential decompression scheme.
A non-transitory computer readable storage medium including instructions that, when executed by a processing system, cause the processing system to perform a method comprising:
- partitioning compressed data into a plurality of data blocks;
- determining whether to decompress the data blocks of interest sequentially or in parallel;
- and decompressing the data blocks accordingly by the client machine using a dictionary-based sequential decompression scheme.
Dependencies are inferred from the claim text.