EP4236263A2

System and method for url fetching retry mechanism

Abstract

A method for overcoming intermittent, temporary, or other fetching failures by using multiple attempts for retrieving a content from a web server to a client device is disclosed. The URL fetching may use direct or non-direct fetching schemes, or a combination thereof. The non-direct fetching method may use intermediate devices, such as proxy server, Data-Center proxy server, tunnel devices, or any combination thereof. Upon sensing a failure of a fetching action, the action is repeated using the same or different parameters or attributes, such as by using different intermediate devices, selected based on different parameters or attributes, such as different countries. The repetitions are limited to a predefined maximum number or attempts. The fetching attempts may be performed by the client device, by an intermediate device in a non- direct fetching scheme, or a combination thereof. Various fetching schemes may be used sequentially until the content is retrieved.

EP4236263A2, drawing sheet 1
Sheet 1 of 81

Term

13.4 yearsto projected expiry

Projected expiry 21 February 2040, counted from filing; an application has no term until it is granted.

  1. Priority
  2. Filed
  3. Published
  4. Today
  5. Projected expiry

18 claims: 10 independent, 8 dependent

  1. 1
    A method for use with content that is stored in a web server and that is identified by a Uniform Resource Locator, URL, and for use with a first server that stores a list of Internet Protocol, IP, addresses, the method comprising:receiving, by the first server from a client device over the Internet, a content request that comprises the URL;selecting, by the first server, a first IP address from the list in response to the receiving of the content request;sending, by the first server to the web server over the Internet, a first Hypertext Transfer Protocol, HTTP, request, that comprises the URL, using the selected first IP address as a source address;receiving, by the first server from the web server over the Internet, in response to the sending of the first HTTP request, a first content;storing, at the first server, the received first content;sending, by the first server to the web server over the Internet, a second HTTP request that comprises the URL, using a second IP address that is different from the selected first IP address, as a source address;receiving, by the first server from the web server over the Internet, in response to the sending of the second HTTP request, a second content;storing, at the first server, the received second content;comparing, by the first server, the stored received first content and the stored received second content;and sending, by the first server to the client device over the Internet, the first content. In response to determining that the first and second contents are identical.
  2. 2
    The method according to any one of the preceding claims, further comprising:sending, by the first server over the Internet, a third HTTP request that comprises the URL;and receiving, by the first server over the Internet, in response to the sending of the third request, a third content.
  3. 4
    The method according to any one of the preceding claims, further comprising N times, wherein N > 1, sending, by the first server to the web server over the Internet, a respective HTTP request that comprises URL.
  4. 5
    The method according to any one of the preceding claims, further comprising responsive to determining that first and second contents are not identical, performing, by the first server, a first error action.
  5. 7
    The method according to any one of the preceding claims, wherein the first HTTP request comprises a first Hypertext Transfer Protocol Secure, HTTPS, request and wherein the second HTTP request comprises a second HTTPS, request.
  6. 8
    The method according to any one of the preceding claims, wherein the first or second content comprises, or consists of, a web-page or a web-site, that includes, consists of, or comprises, a part or whole of a file, text data, audio data, voice data, multimedia data, video data, multiple images, music data, or a computer program.
  7. 9
    The method according to any one of the preceding claims, wherein the first IP address or the second IP address is the IP address of the first server.
  8. 10
    The method according to any one of the preceding claims, wherein the first server comprises, is part of, or is integrates with, a Data-Center, DC, proxy-server.
  9. 11
    The method according to any one of the preceding claims, further comprising selecting, by the first server, the second IP address from the list.
  10. 12
    The method according to any one of the preceding claims, further for use with an intermediate device, wherein the receiving of the second content comprises receiving, by the first server from the web server via the intermediate device over the Internet, of the second content.