Autonomous vehicle adaptive parallel image processing system

A method for controlling an autonomous vehicle control system for a vehicle, comprising:

• receiving, by an adaptive parallel imaging processing system, image data from a plurality of sensors;
• determining, by an execution monitor of the adaptive parallel imaging processing system, an average utilization of each of a plurality of processors of the adaptive parallel imaging processing system over a moving window;
• scheduling, by a service scheduler of the adaptive parallel imaging processing system, image processing tasks into a request queue for each of the plurality of processors based upon the average utilization of each of the plurality of processors over the moving window, capabilities of each of the plurality of processors, and a priority associated with each image processing task;
• processing, by each of the plurality of processors, image processing tasks from the respective request queue associated with each of the plurality of processors;
• and
• generating, by the autonomous vehicle control system, instructions to control at least one vehicle system based upon the processed image processing tasks, the instructions controlling at least one of an acceleration, a braking and a steering of the vehicle.

An autonomous vehicle control imaging system, the autonomous vehicle control imaging system configured to generate instructions to control at least one vehicle system, the autonomous vehicle control system comprising:

• a plurality of vehicle sensors;
• and
• an adaptive parallel imaging processing system configured to process image data from the plurality of sensors, comprising:
• a plurality of processors;
• and
• a resource management system, the resource management system comprising:
• an execution monitor, the execution monitor configured to calculate an average utilization of each of the plurality of processors over a moving window;
• and
• a service scheduler, the service scheduler controlling a request queue for each of the plurality of processors, the service scheduler scheduling image processing tasks based upon image data from the plurality of sensors in the respective request queue for the each of the plurality of processors based upon the average utilization of each of the plurality of processors over the moving window, capabilities of each of the plurality of processors, and a priority associated with each image processing task,
• wherein the plurality of processors are configured to process image processing tasks in order according to the respective request queue for each of the plurality of sensors and the autonomous vehicle control system is configured to generate the instructions to control the at least one vehicle system based upon the processed image processing tasks.