Tool/script that loads all pages on a site

Discussion in 'Products & Tools' started by login, Dec 18, 2007.

  1. #1
    Hi.
    I need a Tool/script that loads all pages on a site without timing out if the pages loads slow. Do you know such a tool?

    greens to good answers :)
     
    login, Dec 18, 2007 IP
  2. ForumJoiner

    ForumJoiner Active Member

    Messages:
    762
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    83
    #2
    Are you looking for a tool that (down)loads all pages from a site, no matter how slow the download is?
     
    ForumJoiner, Dec 18, 2007 IP
  3. login

    login Notable Member

    Messages:
    8,849
    Likes Received:
    349
    Best Answers:
    0
    Trophy Points:
    280
    #3
    Yes, loads or downloads. But no matter how slow the server is responding. The tool have to keep trying until the page is loaded.
     
    login, Dec 18, 2007 IP
  4. ForumJoiner

    ForumJoiner Active Member

    Messages:
    762
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    83
    #4
    Have you tried HTTrack?

    [​IMG]

    In the help file it says:

    TimeOut
    Define what time the engine has to wait if no response if given by a server.
    120 seconds is recommended (less of fast pipes, more if you connection is sloppy)
    You can optionally skip all links from a host that has generated a timeout.
    Warning: if this checkbox is selected, a timeout will eliminate all links from the origin server

    Retries
    Number of retries if a non-fatal error occured (timeout, for example)
    Note that this will not solve fatal errors such as "Not Found" pages and so on!

    Min Transfer Rate
    Minimum transfer rate tolerated on a site. If the transfer rate if slower that the defined value, then the link is skipped. You can optionally skip all links from a host that has generated a "too slow" error.
    Warning: if this checkbox is selected, a "too slow" errors will eliminate all links from the origin server
     
    ForumJoiner, Dec 19, 2007 IP
    login likes this.
  5. login

    login Notable Member

    Messages:
    8,849
    Likes Received:
    349
    Best Answers:
    0
    Trophy Points:
    280
    #5
    1000 thanks :)
    That works.
    Green to you.
     
    login, Dec 19, 2007 IP