Caching of compiled shader programs in a cloud computing environment

A method comprising:

• receiving, from a client device executing an application, a request for a compiled shader program associated with an initial rendering operation;
• obtaining, based on the request, at least one of:
• (i) a shader key representing one or more of a hardware state of the client device or a software state of the client device, or (ii) a shader value derived from a source code of the compiled shader program;
• providing the at least one of the shader key or the shader value as an input to a trained model;
• obtaining, from the trained model, an indication of one or more additional compiled shader programs and, for each additional compiled shader program of the one or more additional compiled shader program, a level of confidence that the respective additional compiled shader program will be requested within a time window associated with one or more subsequent rendering operations;
• retrieving, from a shader cache storing a plurality of compiled shader programs associated with the application, the compiled shader program, and at least one additional compiled shader program of the one or more additional compiled shader programs, the at least one additional compiled shader program having a level of confidence that satisfies one or more confidence criteria;
• and
• providing the compiled shader program and the at least one additional compiled shader program to the client device in accordance with the request.

A non-transitory computer-readable medium storing instructions thereon, wherein the instructions, when executed by a processing device, cause the processing device to:

• receive, from a client device executing an application, a request for a compiled shader program associated with an initial rendering operation;
• obtain, based on the request, at least one of:
• (i) a shader key representing one or more of a hardware state of the client device or a software state of the client device, or (ii) a shader value derived from a source code of the compiled shader program;
• provide the at least one of the shader key or the shader value as an input to a trained model;
• obtain, from the trained model, an indication of one or more additional compiled shader programs and, for each additional compiled shader program of the one or more additional compiled shader program, a level of confidence that the respective additional compiled shader program will be requested within a time window associated with one or more subsequent rendering operations;
• retrieve, from a shader cache storing a plurality of compiled shader programs associated with the application, the compiled shader program, and at least one additional compiled shader program of the one or more additional compiled shader programs, the at least one additional compiled shader program having a level of confidence that satisfies one or more confidence criteria;
• and
• provide the compiled shader program and the at least one additional compiled shader program to the client device in accordance with the request.