Stream Computing Method, Apparatus, and System
AssigneeHuawei Technologies Co., Ltd.
InventorsYunlong Shi, Fengbin Fang
Life of this patent
Estimating the term…
Abstract
A stream computing method applicable to a system including a manager node and a worker node, where the manager node, obtains input channel description information, a structured query language (SQL) statement, and output channel description information, dynamically generates a data stream graph according to the input channel description information, the SQL statement, and the output channel description information, and controlling, according to the data stream graph, a worker node to execute a stream computing task.
Claims20
A stream computing method, wherein the stream computing method is applied to a stream computing system comprising a manager node and a worker node, and wherein the stream computing method comprises:
- obtaining, by the manager node, input channel description information, a structured query language (SQL) statement, and output channel description information from a client;
- generating, by the manager node, a data stream graph according to the input channel description information, the SQL statement, and the output channel description information, wherein the data stream graph defines computational logic of a plurality of operators for executing a stream computing task and a data stream input/output relationship between among the operators;
- and
- controlling, by the manager node according to the data stream graph, the worker node to execute the stream computing task, wherein the input channel description information defines an input channel, wherein the input channel is a logical channel inputting a data stream from a data production system to the data stream graph, wherein the output channel description information defines an output channel, and wherein the output channel is a logical channel outputting an output data stream of the data stream graph to a data consumption system.
A manager node, comprising:
- a memory storing instructions;
- and
- a processor coupled to the memory, wherein the instructions stored in the memory cause the processor to be configured to:
- obtain input channel description information, a structured query language (SQL) statement, and output channel description information from a client;
- generate a data stream graph according to the input channel description information, the SQL statement, and the output channel description information, wherein the data stream graph defines computational logic of a plurality of operators for executing a stream computing task and a data stream input/output relationship among the operators;
- and
- control, according to the data stream graph, a worker node in a stream computing system to execute the stream computing task, wherein the input channel description information defines an input channel, wherein the input channel is a logical channel inputting a data stream from a data production system to the data stream graph, wherein the output channel description information defines an output channel, and wherein the output channel is a logical channel outputting an output data stream of the data stream graph to a data consumption system.
A computer readable storage medium storing a program, in which, when executed by a processor, cause the processor to:
- obtain input channel description information, a structured query language (SQL) statement, and output channel description information from a client;
- generate a data stream graph according to the input channel description information, the SQL statement, and the output channel description information, wherein the data stream graph defines computational logic of a plurality of operators for executing a stream computing task and a data stream input/output relationship among the operators;
- and
- control, according to the data stream graph, a worker node to execute the stream computing task, wherein the input channel description information defines an input channel, wherein the input channel is a logical channel inputting a data stream from a data production system to the data stream graph, wherein the output channel description information defines an output channel, and wherein the output channel is a logical channel outputting an output data stream of the data stream graph to a data consumption system.
Dependencies are inferred from the claim text.