robots.txt for my vBulletin

Discussion in 'robots.txt' started by bessnik, Aug 7, 2009.

  1. #1
    Hi,

    I want to share with you my Robots.txt file and ask any advice from anyone if I am wrong or OK

    User-agent: Slurp
    Allow: /
    Disallow: /admincp
    Disallow: /includes
    Disallow: /modcp
    Disallow: /js
    
    User-agent: Googlebot
    Allow: /
    Disallow: /admincp
    Disallow: /includes
    Disallow: /modcp
    Disallow: /js
    
    User-agent: msnbot
    Allow: /
    Disallow: /admincp
    Disallow: /includes
    Disallow: /modcp
    Disallow: /js
    
    User-agent: *
    Disallow: /
    
    Sitemap: http://www.myvbulletinforum.org/sitemaps_1.xml.gz
    Code (markup):
    Thank you,
    Bess!
     
    Last edited: Aug 7, 2009
    bessnik, Aug 7, 2009 IP
  2. remember123

    remember123 Peon

    Messages:
    620
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Humm...I dont recommend this..because you are disclosing your admincp for the hackers...
    and I also suggest you to change the admincp folder to something which is not predictable and also change it in /includes.php

    also see my post
    http://forums.digitalpoint.com/showthread.php?t=1468182
     
    Last edited: Aug 22, 2009
    remember123, Aug 22, 2009 IP