the new Sitemap parameter and robot.txt file help

Discussion in 'robots.txt' started by imnotadoctor, Apr 12, 2007.

0
  1. #1
    Currently I use Meta Robot tags and not a robot.txt file.

    I wanted to add a robot.txt to include the new Sitemap parameter:

    Sitemap: http://www.example.com/sitemap.xml

    Because I current already use Meta Robot tags and just want to add the new sitemap paramater do I need include anything for in my robot.txt file than:

    Sitemap: http://www.example.com/sitemap.xml
     
    imnotadoctor, Apr 12, 2007 IP
  2. weppos

    weppos Well-Known Member

    Messages:
    99
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    125
    #2
    No, it's not required.
    If you feel more comfortable you can add

    User-agent: *
Disallow:
    HTML:
    that will tell to all spiders to go ahead and index your site.
     
    weppos, Apr 16, 2007 IP
  3. sujit001

    sujit001 Peon

    Messages:
    186
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    There is no need for robot.txt
     
    sujit001, Apr 23, 2007 IP
  4. Claudek

    Claudek Well-Known Member

    Messages:
    1,379
    Likes Received:
    81
    Best Answers:
    0
    Trophy Points:
    165
    #4
    It may help to read the actual question before answering. Your answer is wrong by the way.

    You can put a robots.txt file with just the sitemap line in it. It shuld not affect your indexing in any way. If unsure, the recommendation from weppos is valid.
     
    Claudek, Apr 23, 2007 IP