Streaming Application Upgrading Method, Master Node, and Stream Computing System
AssigneeHuawei Technologies Co., Ltd.
InventorsSibao Hong, Mingzhen Xia, Songshan Zhang
Life of this patent
Estimating the term…
Abstract
A streaming application upgrading method includes obtaining an updated logical model of a streaming application, and determining a to-be-adjusted stream by comparing the updated logical model with an initial logical model; generating an upgrading instruction according to the to-be-adjusted stream; and delivering the generated upgrading instruction to a worker node, so that the worker node adjusts, according to an indication of the upgrading instruction, a stream between PEs distributed on the worker node.
Claims20
A method for upgrading an initial logical model of a streaming application deployed on a stream computing system and implemented by a master node of the stream computing system, wherein the method comprises:
- obtaining an updated logical model of the streaming application when the streaming application is updated, wherein the stream computing system comprises the master node and at least one worker node, wherein a plurality of process elements (PEs) are distributed on one or more worker nodes of the at least one worker node and are each configured to process data of the streaming application, and wherein the initial logical model denotes the PEs processing the data and a direction of a data stream between the PEs;
- determining, by the master node, a to-be-adjusted data stream by comparing the initial logical model with the updated logical model;
- generating an upgrading instruction according to the to-be-adjusted data stream;
- and
- delivering the upgrading instruction to a first worker node of the at least one worker node,
- wherein a PE related to the to-be-adjusted data stream is located at the first worker node, and
- wherein the upgrading instruction instructs the first worker node to adjust a direction of a data stream between PEs distributed on the first worker node.
A master node for upgrading an initial logical model of a streaming application deployed on a stream computing system, wherein the master node comprises:
- an input device;
- an output device;
- a processor;
- and
- a memory storing instructions which, when executed by the processor, cause the master node to:
- obtain an updated logical model of the streaming application using the input device when the streaming application is updated, wherein the stream computing system comprises the master node and at least one worker node, wherein a plurality of process elements (PEs) are distributed on one or more worker nodes of the at least one worker node and are each configured to process data of the streaming application, and wherein the initial logical model denotes the PEs processing the data and a direction of a data stream between the PEs, and
- determine a to-be-adjusted data stream by comparing the initial logical model of the streaming application with the updated logical model;
- generate an upgrading instruction according to the to-be-adjusted data stream;
- and
- deliver the upgrading instruction to a first worker node of the at least one worker node using the output device, wherein a PE related to the to-be-adjusted data stream is located at the first worker node, and wherein the upgrading instruction instructs the first worker node to adjust a direction of a data stream between PEs distributed on the first worker node.
A stream computing system, comprising:
- at least one worker node comprising a plurality of process elements (PEs), wherein the PEs are distributed on one or more worker nodes of the at least one worker node, and are configured to process data of a streaming application deployed in the stream computing system, wherein an initial logical model of the streaming application denotes the PEs processing the data and a direction of a data stream between the PEs;
- and
- a master node coupled to the at least one worker node, wherein the master node is configured to:
- obtain an updated logical model of the streaming application when the streaming application is updated;
- determine a to-be-adjusted data stream by comparing the initial logical model of the streaming application with the updated logical model;
- generating an upgrading instruction according to the to-be-adjusted data stream;
- and
- delivering the upgrading instruction to a first worker node of the at least one worker node, wherein a PE related to the to-be-adjusted data stream is located at the first worker node, and wherein the upgrading instruction instructs the first worker node to adjust a direction of a data stream between PEs distributed on the first worker node, and
- wherein the first worker node is configured to:
- receive the upgrading instruction from the master node;
- and
- adjust, according to an indication of the upgrading instruction, the direction of the data stream between the PEs distributed on the first worker node.
Dependencies are inferred from the claim text.