Compile-time tuple attribute compression
AssigneeInternational Business Machines Corporation
InventorsMichael J. Branson, John M. Santosuosso
Life of this patent
Estimating the term…
Abstract
A method, system, and computer program product for initializing a stream computing application are disclosed. The method may include, during a compiling of code, determining whether an attribute of a tuple to be processed at a first stream operator is to be next processed at a second stream operator. The first stream operator may be configured to transmit the tuple along an execution path to the second stream operator. The execution path includes one or more intervening stream operators between the first and second stream operators. The method may invoke a compression condition when the first attribute of the tuple to be processed at the first stream operator is to be next processed at the second stream operator.
Claims17
A method comprising:
- executing a set of tuples with a set of compute nodes, wherein a first tuple of the set of tuples has a set of attributes that has a first attribute of the set of attributes, and wherein each compute node is adapted to execute a set of stream operators;
- receiving the first tuple;
- determining whether the first attribute to be processed at a first stream operator is to be next processed at a second stream operator, wherein the first stream operator is configured to transmit the first tuple along an execution path including one or more intervening stream operators to the second stream operator;
- and
- compressing the first attribute into a first compressed attribute with a compression condition, in response to determining that the first attribute to be processed at the first stream operator is not to be processed at the second stream operator.
A computer program product, comprising:
- a non-transitory computer readable storage medium having program code stored thereon, the program code configured to:
- execute a set of tuples with a set of compute nodes, wherein a first tuple of the set of tuples has a set of attributes that has a first attribute of the set of attributes, and
- wherein each compute node is adapted to execute a set of stream operators;
- receive the first tuple;
- determine that the first attribute to be processed at a first stream operator is to be next processed at a second stream operator, wherein the first stream operator is configured to transmit the first tuple along an execution path including one or more intervening stream operators to the second stream operator;
- and
- compress the first attribute into a first compressed attribute with a compression condition in response to the determination that the first attribute to be processed at the first stream operator is not to be processed at the second stream operator.
A system for initializing a stream computing application, comprising:
- one or more computer processors;
- and
- a memory containing a program, which when executed by the one or more computer processors is configured to initialize a stream computing application, the initializing comprising:
- executing a set of tuples with a set of compute nodes, wherein a first tuple of the set of tuples has a set of attributes that has a first attribute of the set of attributes, and wherein each compute node is adapted to execute a set of stream operators;
- receiving the first tuple;
- determining whether the first attribute to be processed at a first stream operator is to be next processed at a second stream operator, wherein the first stream operator is configured to transmit the first tuple along an execution path including one or more intervening stream operators to the second stream operator;
- and
- compressing the first attribute into a first compressed attribute with a compression condition in response to determining that the first attribute to be processed at the first stream operator is not to be processed at the second stream operator.
Dependencies are inferred from the claim text.