Vertical federated learning method, apparatus, system and device, and storage medium
AssigneeBeijing Bytedance Network Technology Co., Ltd.
InventorsPeixuan HE, Yao ZHANG, Yang LIU, Ye WU
Life of this patent
Estimating the term…
Abstract
The present disclosure provides a vertical federated learning method, apparatus, system, and device, and a storage medium. The method includes: calculating a noise matrix by a first data party based on a mask matrix, determining a product of a residual vector and the noise matrix as a noise-added residual vector, and sending the noise-added residual vector to a second data party; calculating a gradient vector by the second data party based on the noise-added residual vector to update a model parameter.
Claims22
A vertical federated learning method, comprising:
- receiving a mask matrix corresponding to a third sample set and sent by a second data party in a vertical federated learning system, wherein the third sample set is obtained based on splitting a second sample set of the second data party, and a training sample in the second sample set has a corresponding relationship with a training sample with a tag in a local first sample set;
- calculating a noise matrix corresponding to the third sample set based on the mask matrix corresponding to the third sample set, wherein the noise matrix is composed of a quantity of noise corresponding to each training sample in the third sample set, and the quantity of noise is used for noise addition processing;
- determining a residual vector corresponding to the third sample set, and determining a product of the residual vector and the noise matrix corresponding to the third sample set as a noise-added residual vector corresponding to the third sample set, wherein the residual vector comprises a difference value between a tag value and a current predicted value of a training sample in the third sample set;
- and
- sending the noise-added residual vector corresponding to the third sample set to the second data party, wherein the second data party is used to calculate a gradient vector based on the noise-added residual vector, and to update a model parameter corresponding to the second data party based on the gradient vector to obtain an updated model parameter corresponding to the second data party.
A vertical federated learning method, comprising:
- determining a third sample set based on a local second sample set, and calculating a mask matrix corresponding to the third sample set;
- sending the mask matrix corresponding to the third sample set to a first data party in a vertical federated learning system, wherein the first data party is used to determine a noise-added residual vector corresponding to the third sample set based on the mask matrix, a first sample set stored in the first data party comprises a training sample with a tag, and the training sample with a tag in the first sample set has a corresponding relationship with a training sample in the second sample set;
- acquiring the noise-added residual vector from the first data party, and calculating a gradient vector based on the noise-added residual vector;
- and
- updating a local model parameter based on the gradient vector to obtain an updated model parameter.
A vertical federated learning system, comprising a first data party and at least one second data party, wherein a training sample with a tag in a first sample set of the first data party has a corresponding relationship with a training sample in a second sample set of the second data party;
- the second data party is used to determine a third sample set based on the second sample set, calculate a mask matrix corresponding to the third sample set, and send the mask matrix corresponding to the third sample set to the first data party;
- the first data party is used to calculate a noise matrix corresponding to the third sample set based on the mask matrix corresponding to the third sample set, determine a residual vector corresponding to the third sample set, determine a product of the residual vector and the noise matrix corresponding to the third sample set as a noise-added residual vector corresponding to the third sample set, and send the noise-added residual vector corresponding to the third sample set to the second data party, wherein the noise matrix is composed of a quantity of noise corresponding to each training sample in the third sample set, the quantity of noise is used for noise addition processing, the residual vector comprises a difference value between a tag value and a current predicted value of a training sample in the third sample set;
- and
- the second data party is further used to calculate a gradient vector based on the noise-added residual vector, and to update a local model parameter based on the gradient vector to obtain an updated model parameter corresponding to the second data party.
11-12. (canceled)
(canceled)
Dependencies are inferred from the claim text.