vBulletin robots

Discussion in 'robots.txt' started by 2kau, Mar 28, 2009.

0
  1. #1
    Anyone have a good robots.txt for running vBulletin
     
    2kau, Mar 28, 2009 IP
  2. FreedomFighter1210

    FreedomFighter1210 Banned

    Messages:
    307
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #2
    User-agent: *
    Disallow: /admincp/
    Disallow: /clientscript/
    Disallow: /cpstyles/
    Disallow: /customavatars/
    Disallow: /customprofilepics/
    Disallow: /images/
    Disallow: /modcp/
    Disallow: /ajax.php
    Disallow: /attachment.php
    Disallow: /calendar.php
    Disallow: /cron.php
    Disallow: /editpost.php
    Disallow: /global.php
    Disallow: /image.php
    Disallow: /inlinemod.php
    Disallow: /joinrequests.php
    Disallow: /login.php
    Disallow: /member.php
    Disallow: /memberlist.php
    Disallow: /misc.php
    Disallow: /moderator.php
    Disallow: /newattachment.php
    Disallow: /newreply.php
    Disallow: /newthread.php
    Disallow: /online.php
    Disallow: /poll.php
    Disallow: /postings.php
    Disallow: /printthread.php
    Disallow: /private.php
    Disallow: /profile.php
    Disallow: /register.php
    Disallow: /report.php
    Disallow: /reputation.php
    Disallow: /search.php
    Disallow: /sendmessage.php
    Disallow: /showgroups.php
    Disallow: /subscription.php
    Disallow: /threadrate.php
    Disallow: /usercp.php
    Disallow: /usernote.php
     
    FreedomFighter1210, Apr 2, 2009 IP
  3. teen_titans

    teen_titans Peon

    Messages:
    3
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    WHERE shall i put this?
    if i put this one in ipmart forum?
     
    teen_titans, Apr 4, 2009 IP
  4. FreedomFighter1210

    FreedomFighter1210 Banned

    Messages:
    307
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #4
    You create a file in the root directory of your forums (for example: mywebsite.com/forum) called robots.txt

    Then you simply copy and paste what I posted above into that file and save it.
     
    FreedomFighter1210, Apr 4, 2009 IP
  5. Brandon Sheley

    Brandon Sheley Illustrious Member

    Messages:
    9,721
    Likes Received:
    612
    Best Answers:
    2
    Trophy Points:
    420
    #5
    Brandon Sheley, Apr 4, 2009 IP
  6. FreedomFighter1210

    FreedomFighter1210 Banned

    Messages:
    307
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Throw in a few more links to your site, Loco - I'm sure you don't get enough traffic already. *rolls eyes*
     
    FreedomFighter1210, Apr 4, 2009 IP
  7. craftiness

    craftiness Active Member

    Messages:
    185
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    53
    #7
    that was informative. Thanks
     
    craftiness, Apr 14, 2009 IP
  8. Jhumon

    Jhumon Peon

    Messages:
    51
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I use this

    User-Agent: *
    Disallow: /

    User-Agent: Googlebot
    Disallow: /admincp
    Disallow: /

    User-Agent: *
    Allow: /

    User-Agent: Googlebot
    Allow: /cmg-unlock/
    Allow: /

    User-Agent: *
    Allow: /device-support-section/
    Allow: /

    User-Agent: *
    Allow: /pc-application/
    Allow: /

    User-Agent: *
    Allow: /nokia-hardware-repair/
    Allow: /

    User-Agent: *
    Allow: /lg/
    Allow: /

    User-Agent: *
    Allow: /motorola/
    Allow: /

    User-Agent: *
    Allow: /nokia/
    Allow: /

    User-Agent: *
    Allow: /sagem/
    Allow: /

    User-Agent: *
    Allow: /samsung/
    Allow: /

    User-Agent: *
    Allow: /chinese-made-cloned/
    Allow: /
     
    Jhumon, Jun 5, 2009 IP