System and method for improving content fetching by selecting tunnel devices

A method for fetching a content identified by a content identifier from a web server by using an appliance that serves as an HTTP Proxy client and that is operating in multiple states that includes an idle state and non-idle states, for use with a plurality of HTTP Proxy servers, that includes first and second servers, each of the plurality of servers is connectable to the Internet and is addressable in the Internet using a respective IP address, the first server stores a list of IP addresses, and the appliance that are each connected to the Internet and are each addressable in the Internet using a respective IP address, the method by the appliance comprising:

• storing, operating, or using an operating system, a program process, or a thread;
• monitoring or metering, a resource utilization;
• responsive to being in one of the non-idle states, determining, if an idling condition is met;
• responsive to the determination that the idling condition is met, shifting to the idle state;
• responsive to being in the idle state, determining if an idling condition is met;
• and
• responsive to the determination that the idling condition is not met, shifting to one of the non-idle states;
• receiving, from the first or second server using HTTP Proxy protocol or connection, a first message that comprises the content identifier;
• in response to the receiving of the first message, initiating a communication, with the second server;
• randomly selecting the first server from the plurality of servers using one or more random numbers generated by a random number generator;
• sending, to the selected first server, a second message;
• sending, to the web server, a content request that comprises the content identifier;
• receiving, from the web server, the content, in response to the content request;
• and
• sending, to the first or second server using HTTP Proxy protocol or connection, the content, in response to the first message,
• wherein the communication over the Internet with the first or second server uses Socket Secure (SOCKS) protocol or connection,
• wherein the first or second server serves as an SOCKS server and the appliance serves as an SOCKS client,
• wherein the idling condition is determined to be met based on, or according to, activating or executing the process or thread by the operating system or the program,
• wherein the idling condition is determined to be met based on, or according to, the monitored or metered resource utilization being under a threshold,
• wherein the appliance is associated with a first value that comprises a first numeric value or a first identifier of a feature, a characteristic, or a property of a first attribute type, and
• wherein the appliance is associated with a second value that comprises a second numeric value or a second identifier of a feature, a characteristic, or a property of a second attribute type.