Loading patent…
AssigneeMicrosoft Technology Licensing, LLC
InventorsTaifeng WANG, Wei CHEN, Tie-Yan LIU, Fei GAO, Qiwei YE
Estimating the term…
Various implementations relate to asynchronous training of a machine learning model. A server receives feedback data generated by training the machine learning model from a worker. The feedback data are obtained by the worker with its own training data and are associated with previous values of a set of parameters of the machine learning model at the worker. The server determines differences between the previous values and current values of the set of parameters at the server. The current value may have been updated for once or more due to operation of other workers. Then, the server can update the current values of the set of parameters based on the feedback data and the differences between values of the set of parameters. Thus, the updating does not only take the training result of each worker into consideration but also makes proper compensation for delay between different workers.
A computer-implemented method, comprising:
An electronic device, comprising:
A computer program product stored in a computer storage medium and comprising machine executable instructions which, when executed in a device, cause the device to:
Dependencies are inferred from the claim text.