Methods, apparatus, and articles of manufacture to generate command lists to be offloaded to accelerator circuitry

A non-transitory computer readable medium comprising machine readable instructions which, when executed, cause programmable processor circuitry to:

• predict, with a kernel duration model, a duration of execution of a first kernel based on at least one of a first source location of the first kernel, a first name of the first kernel, a first property of a first argument of the first kernel, or an occupancy of the first kernel, the first kernel to be offloaded to accelerator circuitry;
• predict, with a subsequent kernel model, a tuple of a second kernel and a dependency of the second kernel based on at least one of a second source location of a previous kernel, a second name of the previous kernel, a second property of a second argument of the previous kernel, or a time of submission of the previous kernel;
• and
• determine, with a reinforcement learning model, whether to bundle the first kernel into a command list based on at least one of (a) the duration of execution of the first kernel, (b) the tuple of the second kernel, or (c) the dependency of the second kernel.

An apparatus to generate command lists to be offloaded to accelerator circuitry, the apparatus comprising:

• at least one memory;
• machine readable instructions;
• programmable circuitry to at least one of instantiate or execute the machine readable instructions to:
• predict, with a kernel duration model, a duration of execution of a first kernel based on at least one of a first source location of the first kernel, a first name of the first kernel, a first property of a first argument of the first kernel, or an occupancy of the first kernel;
• predict, with a subsequent kernel model, a tuple of a second kernel and a dependency of the second kernel based on at least one of a second source location of a previous kernel, a second name of the previous kernel, a second property of a second argument of the previous kernel, or a time of submission of the previous kernel;
• and
• determine, with a reinforcement learning model, whether to bundle the first kernel into a command list based on at least one of (a) the duration of execution of the first kernel, (b) the tuple of the second kernel, or (c) the dependency of the second kernel.

A method for generating command lists to be offloaded to accelerator circuitry, the method comprising:

• predicting, with a kernel duration model, a duration of execution of a first kernel based on at least one of a first source location of the first kernel, a first name of the first kernel, a first property of a first argument of the first kernel, or an occupancy of the first kernel;
• predicting, with a subsequent kernel model, a tuple of a second kernel and a dependency of the second kernel based on at least one of a second source location of a previous kernel, a second name of the previous kernel, a second property of a second argument of the previous kernel, or a time of submission of the previous kernel;
• and
• determining, with a reinforcement learning model, whether to bundle the first kernel into a command list based on at least one of (a) the duration of execution of the first kernel, (b) the tuple of the second kernel, or (c) the dependency of the second kernel.