Task scheduling for agent prediction

A method comprising:

• receiving data that characterizes an environment in a vicinity of a vehicle, the environment comprising a plurality of agents;
• identifying available computing resources provided by data processing computer hardware on-board the vehicle;
• processing the data that characterizes the environment to determine a complexity score for each of the plurality of agents, wherein, for each agent, the complexity score defines an estimated amount of computing resources that is required for executing a prediction data generation task with respect to the agent on-board the vehicle;
• determining, based on the complexity score for each of the plurality of agents, a schedule that allocates execution of the prediction data generation tasks with respect to the plurality of agents in the environment across the available computing resources that are provided by the data processing computer hardware on-board the vehicle;
• and
• allocating, in accordance with the schedule, the execution of the prediction data generation tasks with respect to the plurality of agents across the available computing resources that are provided by the data processing computer hardware on-board the vehicle.

A system comprising one or more computers and one or more storage devices storing instructions that, when executed by the one or more computers, cause the one or more computers to perform operations comprising:

• receiving data that characterizes an environment in a vicinity of a vehicle, the environment comprising a plurality of agents;
• identifying available computing resources provided by data processing computer hardware on-board the vehicle;
• processing the data that characterizes the environment to determine a complexity score for each of the plurality of agents, wherein, for each agent, the complexity score defines an estimated amount of computing resources that is required for executing a prediction data generation task with respect to the agent on-board the vehicle;
• determining, based on the complexity score for each of the plurality of agents, a schedule that allocates execution of the prediction data generation tasks with respect to the plurality of agents in the environment across the available computing resources that are provided by the data processing computer hardware on-board the vehicle;
• and
• allocating, in accordance with the schedule, the execution of the prediction data generation tasks with respect to the plurality of agents across the available computing resources that are provided by the data processing computer hardware on-board the vehicle.

One or more non-transitory computer-readable storage media storing instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

• receiving data that characterizes an environment in a vicinity of a vehicle, the environment comprising a plurality of agents;
• identifying available computing resources provided by data processing computer hardware on-board the vehicle;
• processing the data that characterizes the environment to determine a complexity score for each of the plurality of agents, wherein, for each agent, the complexity score defines an estimated amount of computing resources that is required for executing a prediction data generation task with respect to the agent on-board the vehicle;
• determining, based on the complexity score for each of the plurality of agents, a schedule that allocates execution of the prediction data generation tasks with respect to the plurality of agents in the environment across the available computing resources that are provided by the data processing computer hardware on-board the vehicle;
• and
• allocating, in accordance with the schedule, the execution of the prediction data generation tasks with respect to the plurality of agents across the available computing resources that are provided by the data processing computer hardware on-board the vehicle.