Multi-process compression
AssigneeElectronic Data Systems Corporation
InventorPeter D. Rail
Life of this patent
Estimating the term…
Abstract
A system (10) compresses a file (12) to produce a compressed file (14). The system (10) includes a compression splitter (16) that splits the file (12) into subfiles. Compressors (20a, 20b, 20c), operating on one or more microprocessors, compress the subfiles to produce compressed subfiles (22a, 22b, 22c). A compression combiner (26) combines the compressed subfiles (22a, 22b, 22c) to produce the compressed file (14).
Claims32
A system for compressing a file having a plurality of records, the system comprising:
- a splitter operable to partition the file into a first subfile and a second subfile, wherein each subfile comprises a subset of the records contained in the file;
- a first compressor coupled to the splitter and operable to compress the first subfile to produce a first compressed subfile;
- a second compressor coupled to the splitter and operable to compress the second subfile to produce a second compressed subfile;
- and
- a combiner coupled to the compressors, the combiner operable to combine the compressed subfiles produced by the compressors to produce a compressed file.
A method performed on a computer for compressing a file having a plurality of records, the method comprising:
- partitioning the file into a first subfile and a second subfile, wherein each subfile comprises a subset of the records contained in the file;
- compressing the first subfile to produce a first compressed subfile;
- compressing the second subfile to produce a second compressed subfile;
- and
- combining the compressed subfiles to produce a compressed file.
A compressor for compressing a file having a plurality of records with delimited fields, the compressor comprising:
- a first buffer operable to store a first record of the file;
- a second buffer operable to store a second record of the file;
- and
- a processor coupled to the first buffer and the second buffer, the processor operable to compare, on a field-by-field basis, the first record to the second record, the processor operable to replace a field of the second record with a vertical repeat indicator if the field of the second record matches the corresponding field of the first record.
A method for compressing a file having a plurality of records with delimited fields, the method comprising:
- comparing, on a field-by-field basis, a first record of the file to a second record of the file;
- and
- replacing a field of the second record with a vertical repeat indicator if the field of the second record matches the corresponding field of the first record.
A method for decompressing a compressed file having a plurality of records with delimited fields, the method comprising:
- determining, on a field-by-field basis, if a field of a compressed record comprises a vertical repeat indicator;
- and
- writing the field to a buffer if the field of the compressed record is not a vertical repeat indicator.
Dependencies are inferred from the claim text.