Task orchestrator and method for task orchestration and execution

A method for executing a compute task using heterogeneous hardware resources of a compute environment, the method comprising:

• receiving, via an ingress interface, a compute task;
• constructing, by a trained decision tree machine learning model, a base task plan that associates the compute task with hardware resources of the compute environment;
• generating, by a neuromorphic model, one or more task plan variants and a routing score for each task plan variant based on continuously learned routing performance encoded through spike-timing-dependent plasticity (STDP);
• evaluating the base task plan together with the one or more task plan variant by executing a tree search based on one or more of predicted latency, predicted cost, predicted error risk, and predicted policy compliance of executing the compute task;
• selecting a task plan based on a result of the evaluation and the one or more routing scores;
• and
• executing the compute task by dispatching steps of the compute task to hardware resources of the compute environment according to the task plan.