Field level compression in parallel data flows
AssigneeInternational Business Machines Corporation
InventorsLawrence A. Greene, Eric A. Jacobson, Yong Li, Xiaoyan Pu
Life of this patent
Estimating the term…
Loading patent…
AssigneeInternational Business Machines Corporation
InventorsLawrence A. Greene, Eric A. Jacobson, Yong Li, Xiaoyan Pu
Estimating the term…
According to one embodiment of the present invention, a system selectively compresses data fields in a parallel data flow. The system identifies within an execution plan for the parallel data flow a first instance of a data field within a stage of the parallel data flow. The system traces the identified data field through stages of the parallel data flow and determines a score value for the identified data field based on operations performed on the identified data field during traversal of the stages. The system compresses the identified data field based on the score value indicating a performance gain with respect to the compressed data field. Embodiments of the present invention further include a method and computer program product for selectively compressing data fields in a parallel data flow in substantially the same manners described above.
A computer-implemented method of selectively compressing data fields in a parallel data flow comprising:
Dependencies are inferred from the claim text.