Machine learning model scheduler

Apparatus comprising:

• at least one processor;
• and
• at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to:
• obtain a first machine learning model, the first machine learning model comprising at least a first layer;
• obtain a second machine learning model, the second machine learning model comprising at least a second layer;
• determine an execution schedule for executing the first machine learning model and the second machine learning model, wherein the determining the execution schedule further comprises:
• varying a number of processing resources and a start time allocated to the first layer and the second layer;
• and
• execute the first machine learning model and the second machine learning model according to the execution schedule.

A method comprising:

• obtaining a first machine learning model, the first machine learning model comprising at least a first layer;
• obtaining a second machine learning model, the second machine learning model comprising at least a second layer;
• determining an execution schedule for executing the first machine learning model and the second machine learning model, wherein determining the execution schedule further comprises:
• varying a number of processing resources and a start time allocated to the first layer and the second layer;
• and
• executing the first machine learning model and the second machine learning model according to the execution schedule.

A non-transitory computer readable medium comprising program instructions that, when executed by an apparatus, cause the apparatus to perform at least the following:

• obtaining a first machine learning model, the first machine learning model comprising at least a first layer;
• obtaining a second machine learning model, the second machine learning model comprising at least a second layer;
• determining an execution schedule for executing the first machine learning model and the second machine learning model, wherein determining the execution schedule further comprises:
• varying a number of processing resources and a start time allocated to the first layer and the second layer;
• and
• executing the first machine learning model and the second machine learning model according to the execution schedule.