Storage controller accelaration for neural network training and inference

A computer usable program product comprising one or more computer-readable storage devices, and program instructions stored on at least one of the one or more storage devices, the stored program instructions comprising:

• program instructions to receive, by a storage controller of a machine, training data associated with a neural network model, the neural network model including a plurality of layers, and the machine further including at least one graphics processing unit;
• program instructions to train, by the storage controller, at least one layer of the plurality of layers of the neural network model using the training data to generate processed training data, wherein a size of the processed data is less than a size of the training data, and wherein training of the at least one layer includes adjusting one or more weights of the at least one layer using the training data;
• and
• program instructions to send, by the storage controller, the processed training data to at least one graphics processing unit of the machine, the at least one graphics processing unit configured to store the processed training data and train one or more remaining layers of the plurality of layers using the processed training data.

A computer system comprising one or more processors, one or more computer-readable memories, and one or more computer-readable storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, the stored program instructions comprising:

• program instructions to receive, by a storage controller of a machine, training data associated with a neural network model, the neural network model including a plurality of layers, and the machine further including at least one graphics processing unit;
• program instructions to train, by the storage controller, at least one layer of the plurality of layers of the neural network model using the training data to generate processed training data, wherein a size of the processed data is less than a size of the training data, and wherein training of the at least one layer includes adjusting one or more weights of the at least one layer using the training data;
• and
• program instructions to send, by the storage controller, the processed training data to at least one graphics processing unit of the machine, the at least one graphics processing unit configured to store the processed training data and train one or more remaining layers of the plurality of layers using the processed training data.