Method, apparatus and device for data shuffling, computer-readable storage medium and product

An electronic device, comprising a processor and a memory;

• the memory stores computer-executable instructions;
• the processor executes computer-executable instructions stored in the memory, to cause the processor to carry out a method for data shuffling, comprising:
• acquiring a data shuffling request for distributing at least one data to be shuffled pre-stored in a host memory to at least one target server, wherein the data to be shuffled comprises at least one data segment to be sent to different target servers;
• acquiring a shuffling request parameter linked list associated with the at least one data to be shuffled based on the data shuffling request, wherein the shuffling request parameter linked list comprises at least one shuffling request parameter corresponding to the at least one data segment, and the shuffling request parameter comprises associated information of a target server to which the data segment is to be sent and memory buffer information corresponding to the data segment;
• performing a merging operation on shuffling request parameters in the shuffling request parameter linked list according to the data amount of the data segment corresponding to the shuffling request parameter and the memory buffer information to obtain at least one target request parameter composed of at least one shuffling request parameter;
• and caching the data to be shuffled corresponding to the at least one target request parameter to a predetermined remote direct memory access network card;
• and
• distributing respectively data segments associated with at least one data to be shuffled cached in the remote direct memory access network card to the target server indicated in the shuffling request parameter associated with the data segment.

A non-transitory computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions which, when executed by a processor, carry out a method for data shuffling comprising:

• acquiring a data shuffling request for distributing at least one data to be shuffled pre-stored in a host memory to at least one target server, wherein the data to be shuffled comprises at least one data segment to be sent to different target servers;
• acquiring a shuffling request parameter linked list associated with the at least one data to be shuffled based on the data shuffling request, wherein the shuffling request parameter linked list comprises at least one shuffling request parameter corresponding to the at least one data segment, and the shuffling request parameter comprises associated information of a target server to which the data segment is to be sent and memory buffer information corresponding to the data segment;
• performing a merging operation on shuffling request parameters in the shuffling request parameter linked list according to the data amount of the data segment corresponding to the shuffling request parameter and the memory buffer information to obtain at least one target request parameter composed of at least one shuffling request parameter;
• and caching the data to be shuffled corresponding to the at least one target request parameter to a predetermined remote direct memory access network card;
• and
• distributing respectively data segments associated with at least one data to be shuffled cached in the remote direct memory access network card to the target server indicated in the shuffling request parameter associated with the data segment.