Adding path to sitemaps in robots.txt

Discussion in 'robots.txt' started by vic_msn, Apr 26, 2007.

0
  1. #1
    This is the email I received from a newsletter.
    has anyone tried adding the path to sitemap in robots.txt so all spiders can crawl a sitemap and what should be the format of the sitemap google or ror or rss
     
    vic_msn, Apr 26, 2007 IP
  2. weppos

    weppos Well-Known Member

    Messages:
    99
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    125
    #2
    I tried but the same sitemap was arelady submitted via Google Webmaster Tools.
    I would love to try without submitting it. :)
     
    weppos, Apr 28, 2007 IP
  3. Asci

    Asci Banned

    Messages:
    3
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I added the robots.txt file and Sitemaps: http://ascinv.com/ mysitemap.xml, when I submitted the site through an SEO it returned an error saying that line is invalid.

    I did read somewhere else though just to add an empty robot.txt file so it will then index all anyhow.

    Are the meta-tags not used anymore??
     
    Asci, Apr 29, 2007 IP
  4. bscdesign.com

    bscdesign.com Active Member

    Messages:
    681
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    58
    #4
    If that is the exact line you put then it is wrong.

    The correct line is:
    Sitemap: http://ascinv.com/mysitemap.xml
    Code (markup):
     
    bscdesign.com, Apr 30, 2007 IP
  5. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #5
    if you block sitemap url in your robots.txt , nobody can access it. G can not access it too.

    if you add Sitemap: http://ascinv.com/mysitemap.xml this line to your site, G will understand that it's a sitemap
     
    trichnosis, May 11, 2007 IP