Fine-grained data mover

A memory controller device for offloading memory access workloads from a host system in a distributed memory architecture, the memory controller device comprising:

• a processor configured to perform operations comprising:
• receiving a data mover call, the data mover call comprising a request to copy values, a request to gather values, a request to scatter values, or a request to set values, the data mover call specifying one or more source and one or more destination memory locations;
• creating a set of data mover tasks based upon the data mover call, the data mover tasks created based upon a specified mapping between data mover calls and data mover tasks, each data mover task including a read phase and a write phase;
• executing each data mover task in the set by executing each phase of each particular task of the set of data mover tasks by issuing memory access commands corresponding to the phase of the particular one of the set of data mover tasks;
• concurrently executing a plurality of memory commands of the set of data mover tasks on a plurality of memory interface slices, the plurality of memory commands targeting memory locations specified in the data mover call;
• determining that all the data mover tasks for the data mover call have completed;
• and
• sending a response to the data mover call to the host.

A non-transitory machine-readable medium, storing instructions for offloading memory access workloads from a host system in a distributed memory architecture, the instructions, when executed by a processor of a memory controller, cause the memory controller to perform operations comprising:

• receiving a data mover call, the data mover call comprising a request to copy values, a request to gather values, a request to scatter values, or a request to set values, the data mover call specifying one or more source and one or more destination memory locations;
• creating a set of data mover tasks based upon the data mover call, the data mover tasks created based upon a specified mapping between data mover calls and data mover tasks, each data mover task including a read phase and a write phase;
• executing each data mover task in the set by executing each phase of each particular task of the set of data mover tasks by issuing memory access commands corresponding to the phase of the particular one of the set of data mover tasks;
• concurrently executing a plurality of memory commands of the set of data mover tasks on a plurality of memory interface slices, the plurality of memory commands targeting memory locations specified in the data mover call;
• determining that all the data mover tasks for the data mover call have completed;
• and
• sending a response to the data mover call to the host.