Loading patent…
AssigneeInternational Business Machines Corporation
InventorsMichael J. Branson, Jay S. Bryant, James E. Carey, John M. Santosuosso
Estimating the term…
A method for regulating output from stream operators performing a windowing operation may include receiving stream of tuples to be processed by a plurality of processing elements, each processing element having one or more stream operators. The method may also include receiving a first stream of tuples at a first stream operator, the first stream operator being configured to generate a stream of accumulated tuples according to a set of windowing conditions. The method may then include processing the stream of accumulated tuples in response to a window trigger, where the processing generates a quantity of output. At least one processor may then monitor the quantity of output to determine whether the quantity of output exceeds a data output threshold. The processing may then be adjusted, in response to determining that the quantity of output exceeds the data output threshold, to reduce the output to approach the data output threshold.
A computer implemented method for regulating output from one or more stream operators performing a windowing operation, comprising:
A system for processing a stream of tuples comprising:
A computer program product for processing a stream of tuples, the computer program product including a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a processing circuit to cause the processing circuit to perform a method comprising:
A computer implemented method for regulating output from one or more stream operators performing a windowing operation, comprising:
Dependencies are inferred from the claim text.
Drawings are temporarily unavailable. Open the PDF at USPTO
From the US filing history. Foreign family members aren’t listed.
Arrangements for monitoring or testing data switching networks: threshold monitoring
Query execution: data stream processing; Continuous queries
Network utilisation, e.g. volume of load or congestion level: utilisation of link capacity
Flow control; Congestion control: traffic shaping
About 9 years 3 months of term left · ends 27 Jan 2036 (estimated)
The present disclosure relates to stream computing, and more specifically to computing applications that receive streaming data and process the data as it is received.
Database systems are typically configured to separate the process of storing data from accessing, manipulating, or using data stored in a database. More specifically, database systems use a model in which data is first stored and indexed in a memory before subsequent querying and analysis. In general, database systems may not be well suited for performing real-time processing and analyzing streaming data. In particular, database systems may be unable to store, index, and analyze large amounts of streaming data efficiently or in real time.
According to embodiments of the present disclosure, a computer implemented method for regulating output from one or more stream operators performing a windowing operation may include receiving stream of tuples to be processed by a plurality of processing elements operating on one or more processors, each processing element having one or more stream operators. The method may also include receiving a first stream of tuples at a first stream operator, the first stream operator being configured to generate a stream of accumulated tuples according to a set of windowing conditions. The method may then include processing, by the first stream operator, the stream of accumulated tuples in response to a window trigger, where the processing generates a quantity of output. At least one processor may then monitor the quantity of output to determine whether the quantity of output exceeds a data output threshold. The processing may then be adjusted, in response to determining that the quantity of output exceeds the data output threshold, to reduce the output to approach the data output threshold.
The drawings included in the present application are incorporated into, and form part of, the specification. They illustrate embodiments of the present disclosure and, along with the description, serve to explain the principles of the disclosure. The drawings are only illustrative of certain embodiments and do not limit the disclosure.
FIG. 1 illustrates a computing infrastructure configured to execute a stream computing application, according to various embodiments.
FIG. 2 illustrates a more detailed view of a compute node of FIG. 1, according to various embodiments.
While the invention is amenable to various modifications and alternative forms, specifics thereof have been shown by way of example in the drawings and will be described in detail. It should be understood, however, that the intention is not to limit the invention to the particular embodiments described. On the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.
Aspects of the present disclosure relate to stream computing, and in particular, to computing applications that receive streaming data and process the data as it is received. While the present disclosure is not necessarily limited to such applications, various aspects of the disclosure may be appreciated through a discussion of various examples using this context.
Embodiments of the present disclosure are based on the recognition that an operator in a stream processing application can sometimes produce too much data during a windowing operation. Additionally, stream processing applications may want to exercise control over the flow of data through an application graph (e.g., an operator graph) by limiting the amount of processing a given window operation can produce. Accordingly, various embodiments of the present disclosure are directed towards a computer implemented method for regulating (e.g., limiting) the output from one or more stream operators performing a windowing operation. The method may include comparing a quantity of output from a stream operator processing tuples accumulated in a window against a data output threshold, and adjusting the processing of the accumulated tuples to reduce the quantity of output when the output exceeds the data output threshold. Some embodiments are directed towards a system, and computer program product for implementing the method.