Device profiling in GPU accelerators by using host-device coordination

A system comprising:

• at least one processor;
• and
• at least one memory coupled to the at least one processor and storing instructions that, when executed by the at least one processor, cause the system to perform a method comprising:
• compiling a program a first time, wherein the program is to be performed by a co-processor and a host processor, and the compiling the program the first time generates instrumented executable code, the instrumented executable code being operable to cause the host processor to as part of a performance of the program:
• initialize one or more profile counters corresponding to a kernel for updates to be made during the performance of the program;
• and
• invoke the kernel for execution by the co-processor after initializing the one or more profile counters;
• causing the performance of the program by the co-processor after compiling the program the first time and storing profile information associated with the program resulting from the performance, wherein at least a portion of the profile information is based, at least in part, on the one or more profile counters that reflect the updates;
• and
• compiling the program a second time after storing the profile information, wherein the compiling the program the second time results in the program being executable by the co-processor and the host processor according to the profile information.