Data stream processing based on a boundary parameter
AssigneeHewlett Packard Enterprise Development LP
InventorsQiming Chen, Meichun Hsu, Maria G. Castellanos
Life of this patent
Estimating the term…
Abstract
In one implementation, a system for processing a data stream can comprise a station engine, an execution engine, and a synchronize engine. A station engine can provide a stream operator to receive application logic, punctuate the data stream, and determine a number of input channels for parallel processing. The execution engine can perform a behavior of the application logic during a process operation. The synchronize engine can hold data of the data stream associated with a window until each input channel has reached a data boundary based on a boundary parameter.
Claims15
A system for processing a data stream comprising:
- a station engine to provide a stream operator to:
- receive application logic for sliding window processing;
- punctuate the data stream based on a boundary parameter;
- and
- determine a number of input channels for parallel processing;
- an execution engine to perform a behavior of the application logic during a process operation;
- and
- a synchronize engine to hold data of the data stream associated with a window until each input channel has reached a data boundary based on the boundary parameter.
A machine readable storage medium comprising a set of instructions executable by a processor resource to:
- execute a template behavior to initialize parallel processing of a data stream;
- execute a dynamic behavior based on a boundary parameter and application logic for sliding window processing,
- hold a tuple of the data stream when a granule number of the current input is larger than a resolved granule number;
- and
- a process the held tuple of a first window based on the application logic when a second window boundary is achieved.
A method for processing a data stream comprising:
- receiving boundary parameters including a granule size to be a range of tuples, a slide size to be a number of granules, and a window size to be a number of granules;
- invoking application logic to process the data stream based on a sliding window technique, the application logic to be plugged into template logic;
- receiving input from one of a plurality of channels, the data stream to be a processed by the plurality of channels based on the application logic;
- holding a tuple when a current input is larger than a resolved input;
- and
- processing a tuple when a punctuation boundary is achieved.
Dependencies are inferred from the claim text.