1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt for my vBulletin

Discussion in 'robots.txt' started by bessnik, Aug 7, 2009.

0
  1. #1
    Hi,

    I want to share with you my Robots.txt file and ask any advice from anyone if I am wrong or OK

    User-agent: Slurp
Allow: /
Disallow: /admincp
Disallow: /includes
Disallow: /modcp
Disallow: /js

User-agent: Googlebot
Allow: /
Disallow: /admincp
Disallow: /includes
Disallow: /modcp
Disallow: /js

User-agent: msnbot
Allow: /
Disallow: /admincp
Disallow: /includes
Disallow: /modcp
Disallow: /js

User-agent: *
Disallow: /

Sitemap: http://www.myvbulletinforum.org/sitemaps_1.xml.gz
    Code (markup):
    Thank you,
    Bess!
     
    Last edited: Aug 7, 2009
    bessnik, Aug 7, 2009 IP
  2. remember123

    remember123 Peon

    Messages:
    620
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Humm...I dont recommend this..because you are disclosing your admincp for the hackers...
    and I also suggest you to change the admincp folder to something which is not predictable and also change it in /includes.php

    also see my post
    http://forums.digitalpoint.com/showthread.php?t=1468182
     
    Last edited: Aug 22, 2009
    remember123, Aug 22, 2009 IP