Methods and apparatus for high throughput compression of neural network weights

A non-transitory machine executable medium comprising instructions which, when executed, cause one or more processors to at least:

• determine sizes of data lanes in a partition of neural network weights;
• determine a slice size based on a size difference between a first data lane and a second data lane of the data lanes in the partition, the first data lane including first data, the second data lane including second data, the second data of smaller size than the first data;
• cut a portion of the first data from the first data lane based on the slice size;
• and
• append the portion of the first data to the second data lane.

An apparatus comprising:

• first means for determining sizes of data lanes;
• second means for determining a slice size based on a size difference between a first data lane and a second data lane of the data lanes, the first data lane including first data, the second data lane including second data, the second data of a smaller size than the first data;
• means for cutting a portion of the first data from the first data lane based on the slice size;
• and
• means for appending the portion of the first data to the second data lane.