Gradient compressing apparatus, gradient compressing method, and non-transitory computer readable medium

A computer-implemented gradient compressing method comprising:

• calculating, in a hardware processor of a computer, statistics of gradients calculated for a plurality of parameters being learning targets with respect to an error function in learning;
• determining, based on the statistics, whether or not a parameter of the plurality of parameters is a transmission parameter that transmits gradients regarding each of the parameters via a communication network;
• and
• quantizing a gradient representative value being a representative value of gradients for the transmission parameter.

A non-transitory computer readable medium storing a program which, when executed by a processor of a computer performs a method comprising:

• calculating statistics of gradients calculated for a plurality of parameters being learning targets with respect to an error function in learning;
• determining, based on the statistics, whether or not a parameter of the plurality of parameters is a transmission parameter that transmits gradients regarding each of the parameters via a communication network;
• and
• quantizing a gradient representative value being a representative value of gradients for the transmission parameter.