A method, an apparatus and a computer program product for neural network compression

An apparatus for encoding two or more tensors, the apparatus comprising at least one processor, memory including computer program code, the memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:

• processing the two or more tensors having respective dimensions so that the dimensions of said two or more tensors have the same number;
• identifying which axis of each individual tensor is swappable to result in concatenable tensors around an axis of concatenation;
• reshaping the tensors so that the dimensions are modified based on the swapped axis;
• concatenating the tensors around the axis of concatenation to result in a concatenated tensor;
• compressing the concatenated tensor;
• generating syntax structures for carrying concatenation and axis swapping information;
• and
• generating a bitstream by combining the syntax structures and the compressed concatenated tensor.

An apparatus for decoding, the apparatus comprising at least one processor, memory including computer program code, the memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:

• receiving a bitstream comprising a bitstream of a compressed tensor;
• processing the bitstream and identify from syntax structures that the bitstream comprises a compressed concatenated tensor;
• identifying dimensions of individual tensors generating the concatenated tensor;
• identifying from the bitstream an axis swapping information indicating whether axis swapping has been applied;
• decompressing the tensor into a decompressed tensor;
• splitting the decompressed tensor into individual tensors based on the identified dimensions of the individual tensors;
• swapping axis of the individual tensors based on the axis swapping information;
• and
• decomposing the individual tensors so that their final dimensions match with the identified dimensions of the individual tensors.

A method, comprising:

• processing two or more tensors having respective dimensions so that the dimensions of said two or more tensors have the same number;
• identifying which axis of each individual tensor is swappable to result in concatenable tensors around an axis of concatenation;
• reshaping the tensors so that the dimensions are modified based on the swapped axis;
• concatenating the tensors around the axis of concatenation to result in a concatenated tensor;
• compressing the concatenated tensor;
• generating syntax structures for carrying concatenation and axis swapping information;
• and
• generating a bitstream by combining the syntax structures and the compressed concatenated tensor.

A method, comprising:

• receiving a bitstream comprising a bitstream of a compressed tensor;
• processing the bitstream and identifying from syntax structures that the bitstream comprises a compressed concatenated tensor;
• identifying dimensions of individual tensors generating the concatenated tensor;
• identifying from the bitstream an axis swapping information indicating whether axis swapping has been applied;
• decompressing the tensor into a decompressed tensor;
• splitting the decompressed tensor into individual tensors based on the identified dimensions of the individual tensors;
• swapping axis of the individual tensors based on the axis swapping information;
• and
• decomposing the individual tensors so that their final dimensions match with the identified dimensions of the individual tensors.