does this mean this robot.txt disallow my sitemap to be submitted?

Discussion in 'robots.txt' started by etc, Feb 11, 2010.

0
  1. #1 
    User-agent: *
Disallow:

Sitemap: http://mysite.com/sitemap.xml.gz
    Code (markup):
    know nothing about this please explain. :D
     
    etc, Feb 11, 2010 IP
  2. tsweez

    tsweez Peon

    Messages:
    16
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    No, that's not what it means. There are three different functions here...

    1) User-agent - browser, search engine, yahoo, google, etc. The "*" means all user-agents
    2) Disallow: Are there directories or files you don't want crawled? Blank means crawl everything
    3) Sitemap: sitemap location.
     
    tsweez, Feb 11, 2010 IP
  3. cleondann

    cleondann Peon

    Messages:
    23
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    That's is awesome. Thanks ..i m really pleased to know about that coding here.
     
    cleondann, Feb 13, 2010 IP