Data path for gpu machine learning training with key value ssd

A system for machine learning, the system comprising:

• a graphics processing unit;
• a memory connected to the graphics processing unit;
• and
• a key value storage device;
• the key value storage device being connected to the graphics processing unit by a peripheral component interconnect connection;
• the graphics processing unit being configured to perform memory-mapped input and output operations in an input-output region of the memory, and to write one or more key value requests to a key value request queue within the input-output region;
• the key value storage device being configured to:
• perform memory-mapped input and output operations in the input-output region;
• read the one or more key value requests from the key value request queue;
• and
• in response to a key value request of the one or more key value requests, write a value in the input-output region of the memory, the value corresponding to a key of the key value request.

A system for machine learning, the system comprising:

• a graphics processing unit;
• a key value storage device;
• and
• shared memory means for communication between the graphics processing unit and the key value storage device;
• the graphics processing unit being configured send one or more key value requests to the key value storage device via the shared memory means for communication,
• the key value storage device being configured to:
• receive the one or more key value requests;
• and
• in response to a key value request of the one or more key value requests, send a value to the graphics processing unit via the shared memory means for communication, the value corresponding to a key of the key value request.