Just in time GPU executed program cross compilation

A method for just-in-time cross-compiling compiled binaries of application programs that utilize graphics processing unit (GPU) executed programs configured to be executed on a first GPU having a first instruction set architecture (ISA), the method comprising:

• providing a second GPU having a second ISA different from the first ISA of the first GPU;
• executing an application program that utilizes a plurality of GPU-executed programs configured to be executed for the first ISA of the first GPU;
• executing a run-time executable cross-compiler including, while the application program is executing, translating compiled binary of the plurality of GPU-executed programs from the first ISA to the second ISA;
• and executing the translated plurality of GPU-executed programs on the second GPU.

A computing device for just-in-time cross-compiling compiled binaries of application programs that utilize graphics processing unit (GPU) executed programs configured to be executed on a first GPU having a first instruction set architecture (ISA) and a first application binary interface (ABI), the computing device comprising:

• a second GPU having a second ISA and a second ABI different from the first ISA and first ABI of the first GPU;
• and
• a processor configured to:
• execute an application program that utilizes a plurality of GPU-executed programs configured to be executed for the first ISA and first ABI of the first GPU;
• execute a run-time executable cross-compiler configured to, while the application program is being executed:
• preprocess the plurality of GPU-executed programs before performing translation;
• iterate through instructions of the plurality of GPU-executed programs to gather summary data selected from the group consisting of register usage data, memory access pattern data, and implicit control flow graph data;
• translate compiled binary of the plurality of GPU-executed programs from the first ISA to the second ISA based on rules mapping between instructions of the first ISA and the second ISA, and the summary data;
• emulate the first ABI using the hardware resources of the second GPU;
• and
• execute the translated plurality of GPU-executed programs on the second GPU.