Proxy device with delay measuring capability

A method for operating a database that comprises a respective value indicative of performance and availability to a group of servers, each of the servers in the group stores a respective distinct list of Internet Protocol (IP) addresses, for obtaining a first content that comprises a first web page or a part thereof, that is identified by a first Uniform Resource Locator (URL), and that is stored in a first web server, for obtaining a second content that comprises a second web page or a part thereof, that is identified by a second Uniform Resource Locator (URL), and that is stored in a second web server, and for obtaining a third content that comprises a third web page or a part thereof, that is identified by a third Uniform Resource Locator (URL), and that is stored in a third web server, the method comprising:

• receiving, from a requesting client device, a first request for the first content;
• selecting, a first IP address from a first list of IP addresses stored in a first server selected from the group of servers, in response to the identifying of the first request;
• sending, to a first client device that is addressed by the selected first IP address over the Internet, a first Hypertext Transfer Protocol (HTTP) request that comprises the first URL;
• receiving, from the first web server via the first client device over the Internet, in response to the sending of the first HTTP request, the first content;
• measuring, a first delay associated with the receiving of the first content;
• updating, in the database, a respective value associated with the first server, based on the measured first delay;
• receiving, for the requesting client device, a second request for the second content;
• selecting, a second IP address from a second list of IP addresses stored in a second server selected from the group of servers, in response to the identifying of the second request;
• sending, to a second client device that is addressed by the selected second IP address over the Internet, a second HTTP request that comprises the second URL;
• receiving, from the second web server via the second client device over the Internet, in response to the sending of the second HTTP request, the second content;
• measuring, a second delay associated with the receiving of the second content;
• updating, in the database, a respective value associated with the second server, based on the measured second delay;
• receiving, for the requesting client device, a third request for the third content;
• selecting, a third IP address from a third list of IP addresses stored in a third server selected from the group of servers, in response to the identifying of the third request;
• sending, to a third client device that is addressed by the selected third IP address over the Internet, a third HTTP request that comprises the third URL;
• receiving, from the third web server via the third client device over the Internet, in response to the sending of the third HTTP request, the third content;
• measuring, a third delay associated with the receiving of the third content wherein the measuring of the first, second, or third delay further comprises detecting or measuring error;
• and
• updating, in the database, the respective value associated with the third server, based on the measured third delay,
• wherein the respective list of IP addresses are dynamically updated to include IP address of available proxy devices and exclude IP addresses of unavailable proxy devices and wherein the first, second or third IP address is selected from dynamically updated the respective list.