System and method for url fetching retry mechanism
AssigneeBright Data Ltd.
InventorsDerry Shribman, Ofer Vilenski
Life of this patent
Estimating the term…
Loading patent…
AssigneeBright Data Ltd.
InventorsDerry Shribman, Ofer Vilenski
Estimating the term…
A method for overcoming intermittent, temporary, or other fetching failures by using multiple attempts for retrieving a content from a web server to a client device is disclosed. The URL fetching may use direct or non-direct fetching schemes, or a combination thereof. The non-direct fetching method may use intermediate devices, such as proxy server, Data-Center proxy server, tunnel devices, or any combination thereof. Upon sensing a failure of a fetching action, the action is repeated using the same or different parameters or attributes, such as by using different intermediate devices, selected based on different parameters or attributes, such as different countries. The repetitions are limited to a pre-defined maximum number or attempts. The fetching attempts may be performed by the client device, by an intermediate device in a non-direct fetching scheme, or a combination thereof. Various fetching schemes may be used sequentially until the content is retrieved.
A non-transitory computer readable medium, for use with a web server that provides a first content in response to a first Hypertext Transfer Protocol (HTTP) request, that comprises a Uniform Resource Locator (URL), and that is received from a first client device located at a first location, and that provides a second content, that is different from the first content, in response to a second HTTP request, that comprises the URL, and that is received from a second client device located at a second location, the non-transitory computer readable medium containing computer instructions that, when executed by a processor in a first device, cause the processor to perform the steps of:
Dependencies are inferred from the claim text.