Data processing method, apparatus, and system based on gpu on-chip memory

A method for data processing based on a graphics processing unit (GPU) on-chip memory, comprising:

• delivering, by a central processing unit (CPU) device, a GPU computing task to a GPU device;
• and
• creating, by the CPU device, a first GPU thread for obtaining first data and a second GPU thread for preloading second data and performing GPU computing, wherein the first data comprise writable data needed by the GPU computing task, and the second data comprise read-only data that are needed by the GPU computing task and that are stored in a GPU global memory;
• initiating, by the GPU device, a data obtaining operation for the first data on the first GPU thread after the GPU computing task is started;
• when the first GPU thread performs the data obtaining operation, initiating, by the GPU device on the second GPU thread, a data preloading process of preloading the second data from the GPU global memory to a GPU on-chip memory;
• and
• in response to that a data obtaining process of the first data and the data preloading process of the second data are completed, executing, by the GPU device, the GPU computing task on the second GPU thread based on the first data and the second data.

A computer-implemented device, comprising:

• one or more processors;
• and
• one or more tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more processors, perform one or more operations comprising:
• initiating a data obtaining operation for first data on a first GPU thread, wherein the first data comprise writable data needed by a GPU computing task;
• when the first GPU thread performs the data obtaining operation, initiating, on a second GPU thread, a data preloading process of preloading second data from a GPU global memory to a GPU on-chip memory, wherein the second data comprise read-only data that are needed by the GPU computing task and that are stored in the GPU global memory;
• and
• in response to that a data obtaining process of the first data and the data preloading process of the second data are completed, executing the GPU computing task on the second GPU thread based on the first data and the second data.

A data processing system, comprising:

• a central processing unit (CPU) device configured to:
• deliver a GPU computing task to a GPU device;
• and
• create a first GPU thread for obtaining first data and a second GPU thread for preloading second data and performing GPU computing, wherein the first data comprise writable data needed by the GPU computing task, and the second data comprise read-only data that are needed by the GPU computing task and that are stored in a GPU global memory;
• and
• the GPU device configured to:
• initiate a data obtaining operation for the first data on the first GPU thread after the GPU computing task is started;
• when the first GPU thread performs the data obtaining operation, initiate, on a second GPU thread, a data preloading process of preloading second data from a GPU global memory to a GPU on-chip memory, wherein the second data comprise read-only data that are needed by the GPU computing task and that are stored in the GPU global memory;
• and
• in response to that a data obtaining process of the first data and the data preloading process of the second data are completed, execute the GPU computing task on the second GPU thread based on the first data and the second data.