1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

sitemap question

Discussion in 'Google Sitemaps' started by nemis1s9, Sep 12, 2010.

  1. #1
    hi,

    I have 50,000 urls that need to be visited by a bot/browser before they can be compiled into a sitemap. Would there be a program like an autoclicker that clicks the 50,000 urls in a list 1 by 1, say, every 20 seconds?
    SEMrush
     
    nemis1s9, Sep 12, 2010 IP
    SEMrush
  2. websitetools

    websitetools Well-Known Member

    Messages:
    1,508
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #2
    Any reason you don't use a sitemap generator program like e.g. A1 Sitemap Generator? Under all circumstances, using such crawler/sitemapper software will make requests to all URLs in your website. (And then why not generate the sitemap using those tools as well?)
     
    websitetools, Sep 12, 2010 IP