Back to results
US 2022/0012288 A1Published application
Stream Computing Method, Apparatus, and System
AssigneeHuawei Technologies Co., Ltd.
InventorsYunlong Shi, Fengbin Fang
Life of this patent
Estimating the term…
Abstract
A stream computing method performed by a manager node includes obtaining input channel description information, a structured query language (SQL) statement, and output channel description information, dynamically generating a data flow diagram according to the input channel description information, the SQL statement, and the output channel description information, and controlling, according to the data flow diagram, a worker node to execute a stream computing task.
Claims20
A stream computing method performed by a manager node of a stream computing system, wherein the stream computing method comprises:
- generating a first data flow diagram according to input channel description information, a structured query language (SQL) statement, and output channel description information, wherein the first data flow diagram comprises a plurality of logical nodes, wherein the input channel description information defines an input channel, wherein the input channel is a first logical channel for inputting an input data stream from a data production system to the first data flow diagram, wherein the output channel description information defines an output channel, and wherein the output channel is a logical channel for outputting an output data stream of the first data flow diagram to a data consumption system;
- classifying the logical nodes in the first data flow diagram to obtain a plurality of logical node groups;
- selecting, from a preset operator library, a common operator corresponding to each logical node group of the logical node groups;
- generating a second data flow diagram according to the common operator, wherein each operator in the second data flow diagram implements functions of one or more logical nodes in a logical node group corresponding to the operator;
- and
- controlling, according to the second data flow diagram, a worker node of the stream computing system to execute a stream computing task.
3 more elements
A manager node, comprising:
- a memory configured to store instructions;
- and
- a processor coupled to the memory and configured to execute the instructions to cause the manager node to:
- generate a first data flow diagram according to input channel description information, a structured query language (SQL) statement, and output channel description information, wherein the first data flow diagram comprises a plurality of logical nodes, wherein the input channel description information defines an input channel, wherein the input channel is a logical channel for inputting an input data stream from a data production system to the first data flow diagram, the output channel description information defines an output channel, and wherein the output channel is a logical channel for outputting an output data stream of the first data flow diagram to a data consumption system;
- classify the logical nodes in the first data flow diagram to obtain a plurality of logical node groups;
- select, from a preset operator library, a common operator corresponding to each logical node group of the logical node groups;
- and
- generate a second data flow diagram according to the common operator, wherein each operator in the second data flow diagram implements functions of one or more logical nodes in a logical node group corresponding to the operator;
- and
- control, according to the second data flow diagram, a worker node of a stream computing system to execute a stream computing task.
7 more elements
A computer program product comprising instructions that are stored on a computer-readable medium and that, when executed by a processor, cause a manager node to:
- generate a first data flow diagram according to input channel description information, a structured query language (SQL) statement, and output channel description information, wherein the first data flow diagram comprises a plurality of logical nodes, wherein the input channel description information defines an input channel, wherein the input channel is a logical channel for inputting an input data stream from a data production system to the first data flow diagram, wherein the output channel description information defines an output channel, and wherein the output channel is a logical channel for outputting an output data stream of the first data flow diagram to a data consumption system;
- classify the logical nodes in the first data flow diagram to obtain a plurality of logical node groups;
- select, from a preset operator library, a common operator corresponding to each logical node group of the logical node groups;
- and
- generate a second data flow diagram according to the common operator, wherein each operator in the second data flow diagram implements functions of one or more logical nodes in a logical node group corresponding to the operator;
- and
- control, according to the second data flow diagram, a worker node of a stream computing system to execute the stream computing task.
4 more elements
Dependencies are inferred from the claim text.