Loading models on nodes having multiple model service frameworks

A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations comprising:

• determining, based on a preset execution script and resource information of multiple execution nodes, loading-tasks corresponding to the execution nodes, wherein each execution node is deployed on a corresponding cluster node;
• and
• sending loading requests to the execution nodes, thereby causing the execution nodes to start execution processes based on the corresponding loading requests, wherein:
• the execution processes start multiple model service frameworks on each cluster node;
• multiple models are loaded onto each of the model service frameworks;
• each loading request comprises loading-tasks corresponding to the execution node to which the loading request was sent;
• and
• the execution processes comprise a respective execution process for each model service framework.

A computer-implemented system, comprising:

• one or more computers;
• and
• one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform one or more operations comprising:
• determining, based on a preset execution script and resource information of multiple execution nodes, loading-tasks corresponding to the execution nodes, wherein each execution node is deployed on a corresponding cluster node;
• and
• sending loading requests to the execution nodes, thereby causing the execution nodes to start execution processes based on the corresponding loading requests, wherein:
• the execution processes start multiple model service frameworks on each cluster node;
• multiple models are loaded onto each of the model service frameworks;
• each loading request comprises loading-tasks corresponding to the execution node to which the loading request was sent;
• and
• the execution processes comprise a respective execution process for each model service framework.