# US 2015/0311915 A1 · Field level compression in parallel data flows

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0311915 A1
- Document ID: US20150311915A1
- Status: Published application
- Kind: A1
- Application number: 14/645,048
- Filed: 2015-03-11
- Published: 2015-10-29
- Earliest claimed: 2014-04-25
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Lawrence A. Greene; Eric A. Jacobson; Yong Li; Xiaoyan Pu
- Web page: https://patentgrep.com/patent/US20150311915A1

## CPC

- H03M 7/30: Compression (speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N); Expansion; Suppression of unnecessary data, e.g. redundancy reduction
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04L 69/04: Protocols for data compression, e.g. ROHC
- H04L 69/14: Multichannel or multilink protocols
- H03M: CODING; DECODING; CODE CONVERSION IN GENERAL (using fluidic means F15C4/00; optical analogue/digital converters G02F7/00; coding, decoding or code conversion, specially adapted for particular applications, see the relevant subclasses, e.g. G01D, G01R, G06F, G06T, G09G, G10L, G11B, G11C, H04B, H04L, H04M, H04N; ciphering or deciphering for cryptography or other purposes involving the need for secrecy G09C)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

According to one embodiment of the present invention, a system selectively compresses data fields in a parallel data flow. The system identifies within an execution plan for the parallel data flow a first instance of a data field within a stage of the parallel data flow. The system traces the identified data field through stages of the parallel data flow and determines a score value for the identified data field based on operations performed on the identified data field during traversal of the stages. The system compresses the identified data field based on the score value indicating a performance gain with respect to the compressed data field. Embodiments of the present invention further include a method and computer program product for selectively compressing data fields in a parallel data flow in substantially the same manners described above.

## Claims

### Claim 1

A computer-implemented method of selectively compressing data fields in a parallel data flow comprising:
identifying within an execution plan for the parallel data flow a first instance of a data field within a stage of the parallel data flow;
tracing the identified data field through stages of the parallel data flow and determining a weighted compression score value for the identified data field based on operations performed on the identified data field during traversal of the stages; and
compressing the identified data field based on the weighted compression score value indicating a performance gain with respect to the compressed data field.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein compressing the identified data field further comprises:
compressing the identified data field based on a comparison of the weighted compression score value to a predetermined threshold.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein determining a weighted compression score value further comprises:
assigning weights to the operations performed on the identified data field, wherein the weighted compression score value is determined based on sums of the weighted operations for the identified data field in compressed and uncompressed states.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein tracing the identified data field further comprises:
tracing the identified data field from a first stage where the identified data field is accessed to each downstream data stage at which the identified data field is subsequently accessed.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, further comprising:
selectively combining the identified data field in an uncompressed state with another uncompressed data field within the parallel data flow having common ones of the first and second stages in order to compress the combined data fields.

### Claim 6 (depends on 3)

The computer-implemented method of claim 3, further comprising:
tuning the assigned weights to adapt data field compression for a plurality of data types to a system implementing the parallel data flow.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, further comprising:
providing access to uncompressed data of the compressed data field during traversal of the stages.
