Methods and apparatuses for compressing parameters of neural networks

A method for decoding weight parameters of a neural network, the method comprising:

• acquiring a plurality of bits representing weight parameters of the neural network;
• decoding the weight parameters of the neural network using a context-dependent arithmetic coding;
• selecting a context for a decoding of a weight parameter, or for a decoding of a syntax element of a number representation of the weight parameter, in dependence on one or more previously decoded weight parameters and/or in dependence on one or more previously decoded syntax elements of a number representation of one or more weight parameters;
• wherein the weight parameter, or a syntax element of the weight parameter, is decoded using the selected context;
• and
• selecting a context for a decoding of a zero flag of the weight parameter out of at least three different zero flag contexts.

A non-transitory computer readable medium storing a computer program indicating instructions that, when executed by at least one processor of a computing device, cause the computing device to perform a method for decoding weight parameters of a neural network, wherein the method comprises operations:

• acquiring a plurality of bits representing weight parameters of the neural network;
• decoding the weight parameters of the neural network using a context-dependent arithmetic coding;
• selecting a context for a decoding of a weight parameter, or for a decoding of a syntax element of a number representation of the weight parameter, in dependence on one or more previously decoded weight parameters and/or in dependence on one or more previously decoded syntax elements of a number representation of one or more weight parameters;
• wherein the weight parameter, or a syntax element of the weight parameter, is decoded using the selected context;
• and
• selecting a context for a decoding of a zero flag of the weight parameter out of at least three different zero flag contexts.

An encoder for encoding weight parameters of a neural network, the encoder comprising:

• a communication interface;
• a memory storing instructions;
• and
• a processor which is coupled to the communication interface and the memory, to execute the instructions stored in the memory to implement operations comprising:
• obtaining a plurality of weight parameters of the neural network;
• encoding the weight parameters of the neural network using a context-dependent arithmetic coding;
• selecting a context for an encoding of a weight parameter, or for an encoding of a syntax element of a number representation of the weight parameter, in dependence on one or more previously encoded weight parameters and/or in dependence on one or more previously encoded syntax elements of a number representation of one or more weight parameters;
• encoding the weight parameter, or a syntax element of the weight parameter, using the selected context;
• and
• selecting a context for an encoding of a zero flag of the weight parameter out of at least three different zero flag contexts.