Training method for a deep learning model
AssigneeBeijing Baidu Netcom Science Technology Co., Ltd.
InventorsShuohuan WANG, Junyuan SHANG, Yinqi YANG, Guoxia WANG, Linhao ZHANG, Yu SUN, Hua WU, Haifeng WANG
Life of this patent
Estimating the term…
Loading patent…
AssigneeBeijing Baidu Netcom Science Technology Co., Ltd.
InventorsShuohuan WANG, Junyuan SHANG, Yinqi YANG, Guoxia WANG, Linhao ZHANG, Yu SUN, Hua WU, Haifeng WANG
Estimating the term…
A training method, an inference method, a device, an apparatus, and a medium for a deep learning model are provided. A first model includes a plurality of first parameters, a second model comprises a plurality of second parameters, which is initialized to parameter values of a plurality of target parameters selected from the plurality of first parameters. The training method includes: determining a target loss for both the first model and the second model; adjusting parameter values, including: in response to determining that the target loss indicates that the parameter values of at least part of the target parameters need to be adjusted, synchronously adjusting the parameter values of the corresponding second parameters; and in response to determining that the target loss indicates that the parameter values of at least part of the second parameters need to be adjusted, synchronously adjusting the parameter values of the corresponding target parameters.
A training method for a deep learning model, wherein a first deep learning model comprises a plurality of first parameters, a second deep learning model comprises a plurality of second parameters, a number of the plurality of second parameters is less than a number of the plurality of first parameters, the plurality of first parameters includes a plurality of target parameters corresponding to the plurality of the second parameters, wherein the plurality of the second parameters are initialized to parameter values of the plurality of target parameters, the method comprises:
An inference method for a deep learning model, wherein a first deep learning model comprises a plurality of first parameters, a second deep learning model comprises a plurality of second parameters, a number of the plurality of second parameters is less than a number of the plurality of first parameters, the plurality of first parameters includes a plurality of target parameters corresponding to the plurality of the second parameters, wherein the plurality of the second parameters are initialized to parameter values of the plurality of target parameters, the first deep learning model and the second learning model are trained by performing training operations, the training operations comprises:
A electronic device, comprising:
Dependencies are inferred from the claim text.