http://www.xml-sitemaps.com

Discussion in 'Google Sitemaps' started by Mitchell69, Jun 21, 2008.

0
Page 2 of 2
  1. Jihoy

    Jihoy Well-Known Member

    Messages:
    582
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    135
    #21
    Anyone got a sitemap generator that can allow up to 30,000+ pages? I don't mind paying. Also if the generator follows robots.txt would be nice. Seems like a lot of sitemap generators are just randomly grabbing URLs.
     
    Jihoy, Aug 2, 2009 IP
  2. moines

    moines Peon

    Messages:
    23
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #22
    What do you mean under "follows": skipping files and folders Disallow'ed in robots.txt?
     
    moines, Aug 2, 2009 IP
  3. hostmela

    hostmela Well-Known Member

    Messages:
    350
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    130
    #23
    thx for share it i am added it really helpfull.
     
    hostmela, Aug 2, 2009 IP
  4. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #24
    A1 Sitemap Generator can both things without any problem. Here's the link to Robots.txt, noindex, nofollow, canonical etc. information.
     
    websitetools, Aug 2, 2009 IP
Page 2 of 2