Combining pipelines for a streaming data system
AssigneeMicro Focus LLC
InventorsViji Kakkattu Ravindran, Tamilarasi Kaliyamoorthy, Vineetha Vasudevan
Life of this patent
Estimating the term…
Abstract
A technique includes comparing a first sequence of tasks of a first data processing pipeline of a plurality of data processing pipelines for a data streaming system to a second data processing pipeline of the plurality of data processing pipelines. The technique includes, based on the comparing, combining the first data processing pipeline and the second data processing pipeline into a single data processing pipeline.
Claims20
A method comprising:
- comparing a first sequence of tasks of a first data processing pipeline of a plurality of data processing pipelines for a data streaming system to a second sequence of tasks of a second data processing pipeline of the plurality of data processing pipelines;
- and
- based on the comparing, combining the first data processing pipeline and the second data processing pipeline into a single data processing pipeline.
An apparatus comprising:
- a processor;
- and
- a memory to store instructions that, when executed by the processor, cause the processor to:
- receive data describing a plurality of data processing pipelines for a streaming system;
- based on a graph analysis of the plurality of data processing pipelines derived from the data, combine a first data processing pipeline of the plurality of data processing pipelines with a second data processing pipeline of the plurality of data processing pipelines.
A non-transitory machine readable storage medium storing instructions that, when executed by a machine, cause the machine to:
- read a first pipeline definition representing a first pipeline to be added to a streaming system;
- compare the first pipeline definition with a second pipeline definition representing a second pipeline being executed by the streaming system;
- based on the comparison, combine the first pipeline definition and the second pipeline definition to create a third pipeline definition representing a single pipeline;
- and
- controlling the streaming system to replace the second pipeline with the single pipeline.
Dependencies are inferred from the claim text.