Social Buttons
  1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

http://www.xml-sitemaps.com

Discussion in 'Google Sitemaps' started by Mitchell69, Jun 21, 2008.

0
Page 2 of 2
  1. Jihoy

    Jihoy Well-Known Member Premium Member

    Messages:
    579
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    135
    #21
    Anyone got a sitemap generator that can allow up to 30,000+ pages? I don't mind paying. Also if the generator follows robots.txt would be nice. Seems like a lot of sitemap generators are just randomly grabbing URLs.
    SEMrush
     
    Jihoy, Aug 2, 2009 IP
    SEMrush
  2. moines

    moines Peon

    Messages:
    23
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #22
    What do you mean under "follows": skipping files and folders Disallow'ed in robots.txt?
     
    moines, Aug 2, 2009 IP
  3. hostmela

    hostmela Active Member

    Messages:
    349
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    80
    #23
    thx for share it i am added it really helpfull.
     
    hostmela, Aug 2, 2009 IP
  4. websitetools

    websitetools Well-Known Member

    Messages:
    1,508
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #24
    A1 Sitemap Generator can both things without any problem. Here's the link to Robots.txt, noindex, nofollow, canonical etc. information.
     
    websitetools, Aug 2, 2009 IP
Page 2 of 2