Pixel-based load balancing

A system for load-balancing image processing requests across a plurality of first and second servers in a distributed computing system that provides a content delivery network (CDN), the system comprising:

• A. a first server configured to receive a client request for a first image, and to send a request to process the first image to a second server;
• B. a second server configured to:
• receive the request to process the first image, the request comprising an identification of the first image and a directive to process the first image in accordance with a first image processing service;
• determine a value representative of a number of pixels in the first image, wherein said determination comprises at least one of:
• (a) counting the number of pixels in the first image and (b) reading pixel information from an HTTP header of the request to process the first image;
• determine a pixel load for each of a plurality of image servers in the CDN, each pixel load based at least in part on a value representative of a number of pixels in queue for a respective image server in the plurality of image servers;
• determine a pixel drain rate for each of the plurality of image servers, each pixel drain rate based at least in part on a number of pixels processed during a time period by a respective image server in the plurality of image servers;
• based at least in part on the determination of pixel loads and pixel drain rates for each of the plurality image servers, determining an expected response time for each of the plurality of image servers;
• load balance amongst the plurality of image servers, at least by:
• assigning the request to process the first image to a first image server of the plurality of image servers in a content delivery network (CDN) because the first image server offers the lowest expected response time for processing the first image, at the time of the request to process the first image;
• C. wherein the first and second servers each comprise circuitry forming a processor and memory storing processor readable instructions for execution on the processor to operate as described above.

A non-transitory computer-readable medium storing computer program instructions for executing a method on the computer, the method comprising load-balancing image processing requests across a plurality of image servers in a distributed computing system that provides a content delivery network (CDN), the method comprising:

• receiving a request to process a first image, the request comprising an identification of the first image and a directive to process the first image in accordance with a first image processing service;
• determining a value representative of a number of pixels in the first image, wherein said determination comprises at least one of:
• (a) counting the number of pixels in the first image and (b) reading pixel information from an HTTP header of the request;
• determining a pixel load for each of the plurality of image servers, each pixel load based at least in part on a value representative of a number of pixels in queue for a respective image server in the plurality of image servers;
• determining a pixel drain rate for each of the plurality of image servers, each pixel drain rate based at least in part on a number of pixels processed during a time period by a respective image server in the plurality of image servers;
• based at least in part on the determination of pixel loads and pixel drain rates for each of the plurality image servers, determining an expected response time for each of the plurality of image servers;
• load balancing, at least by:
• assigning the request to a first image server of the plurality of image servers in a content delivery network (CDN) because the first image server offers the lowest expected response time for processing the first image, at the time of the request.