Aggregating data in a computer cluster with multiple groups
AssigneeHuawei Technologies Co., Ltd.
InventorQihang Duan
Life of this patent
Estimating the term…
Abstract
This application provides a data processing method. One example method includes: A switching node, that is, a first top node, that is in a first group and that is configured to communicate with a second top node in a second group receives first data sent by a child node; then the first top node receives second data sent by the second top node; and then the first top node aggregates the first data and the second data, to obtain third data.
Claims20
A data processing method, wherein the method comprises:
- receiving, by a first top node, a plurality of pieces of first data, wherein each of the plurality of pieces of first data is sent by a different child node of a plurality of child nodes, wherein the first top node is a switching node that is in a first group in which the first top node is located and that is configured to communicate with a second top node in a second group, each child node of the plurality of child nodes is a node that is in the first group and that is directly connected to the first top node, and the second top node is a switching node that is in the second group and that is configured to communicate with the first top node in the first group, wherein the second top node is not a child node of the first top node, wherein the first group and the second group are located in to a computing cluster, and there is at least one direct link between each group and each of other groups in the computing cluster;
- receiving, by the first top node, second data sent by the second top node;
- and
- aggregating, by the first top node, the first data and the second data, to obtain third data, wherein the aggregating, by the first top node, the first data and the second data, to obtain third data comprises:
- aggregating, by the first top node, the plurality of pieces of first data sent by the plurality of child nodes, to obtain aggregated first data;
- and
- aggregating, bythe first top node, the second data and the aggregated first data, to obtain the third data.
A data processing apparatus, comprising:
- at least one processor;
- and
- one or more memories coupled to the at least one processor and storing programming instructions for execution by the at least one processor to cause the apparatus to:
- receive a plurality of pieces of first data, wherein each of the plurality of pieces of first data is sent by a different child node of a plurality of child nodes wherein the apparatus is a switching node that is in a first group in which the apparatus is located and that is configured to communicate with a second top node in a second group, the second top node is a switching node that is in the second group and that is configured to communicate with the apparatus in the first group, wherein the second top node is not a child node of the apparatus, wherein the first group and the second group are located in a computing cluster, and there is at least one direct link between each group and each of other groups in the computing cluster, and wherein each child node of the plurality of child nodes is a node that is in the first group and that is directly connected to the apparatus,
- receive second data sent by the second top node;
- and
- aggregate the first data and the second data, to obtain third data, wherein the aggregate the first data and the second data, to obtain third data comprises:
- aggregate the plurality of pieces of first data sent by the plurality of child nodes, to obtain aggregated first data;
- and
- aggregate the second data and the aggregated first data, to obtain the third data.
A non-transitory computer-readable storage medium, comprising instructions which, when executed by one or more processors, cause a first top node to:
- receive a plurality of pieces of first data, wherein each of the plurality of pieces of first data is sent by a different child node of a plurality of child nodes, wherein the first top node is a switching node that is in a first group in which the first top node is located and that is configured to communicate with a second top node in a second group, each child node of the plurality of child nodes is a node that is in the first group and that is directly connected to the first top node, and the second top node is a switching node that is in the second group and that is configured to communicate with the first top node in the first group, wherein the second top node is not a child node of the first top node, wherein the first group and the second group are located in to a computing cluster, and there is at least one direct link between each group and each of other groups in the computing cluster;
- receive second data sent by the second top node;
- and
- aggregate the first data and the second data, to obtain third data, wherein the aggregate the first data and the second data, to obtain third data comprises:
- aggregate the plurality of pieces of first data sent by the plurality of child nodes, to obtain aggregated first data;
- and
- aggregate the second data and the aggregated first data, to obtain the third data.
Dependencies are inferred from the claim text.