Dynamic compression by reinforcement learning in a distributed learning environment
OwnerYaniv Ben-Izhak, Shay Vargaftikinventors
Life of this patent
Estimating the term…
Loading patent…
OwnerYaniv Ben-Izhak, Shay Vargaftikinventors
Estimating the term…
An example device includes: a first system configured to implement a model having first parameters, generate gradients for the first parameters in response to training the model on first data sets, and compress the gradients based on second parameters; and circuits in the first system, the circuits including a network interface controller. The first system is further configured to receive updates to the second parameters from a second system through the network interface controller coupled to a network, send the gradients as compressed to a third system through the network interface controller, and apply the updates to the second parameters to adjust resource consumption of at least one of the circuits.
A device, comprising:
An apparatus, comprising:
A method of data transmission in a network, comprising:
Dependencies are inferred from the claim text.