Robots.txt for SMF Forum

Discussion in 'robots.txt' started by pradip200, Mar 23, 2013.

0
  1. #1
    Hi
    Can anyone tell me the right Robots.txt for SMF Forum? I got the below configuration from a forum.


    Disallow: /index.php?action=search*
    Disallow: /index.php?action=calendar*
    Disallow: /index.php?action=login*
    Disallow: /index.php?action=register*
    Disallow: /index.php?action=profile*
    Disallow: /index.php?action=stats*
    Disallow: /index.php?action=arcade*
    Disallow: /index.php?action=printpage*
    Disallow: /index.php?PHPSESSID=*
    Disallow: /index.php?*rss*
    Disallow: /index.php?*wap*
    Disallow: /index.php?*wap2*
    Disallow: /index.php?*imode*
    Disallow: /Themes/*
    Disallow: *msg*
     
    pradip200, Mar 23, 2013 IP
  2. palsman

    palsman Active Member

    Messages:
    156
    Likes Received:
    1
    Best Answers:
    1
    Trophy Points:
    95
    #2
    it's looks like good.
     
    palsman, Apr 19, 2013 IP
  3. humtuma

    humtuma Notable Member

    Messages:
    1,225
    Likes Received:
    24
    Best Answers:
    3
    Trophy Points:
    250
    #3
    Try this-
    User-agent: *
    Allow: /forum/*board
    Allow: /forum/*topic
    Allow: /forum/$
    Allow: /forum/*action=.xml
    Disallow: /forum/go.php
    Disallow: /forum/*PHPSESSID
    Disallow: /forum/*wap
    Disallow: /forum/*wap2
    Disallow: /forum/*board=*wap
    Disallow: /forum/*board=*wap2
    Disallow: /forum/*topic=*wap
    Disallow: /forum/*topic=*wap2
    Disallow: /forum/attachments/
    Disallow: /forum/Packages/
    Disallow: /forum/Smileys/
    Disallow: /forum/Sources/
    Disallow: /forum/Themes/
    Disallow: /forum/archive2.php
    Disallow: /forum/index.php?action=dlattach
    Disallow: /forum/index.php?action=activate
    Disallow: /forum/index.php?action=admin
    Disallow: /forum/index.php?action=calendar
    Disallow: /forum/index.php?action=emailuser
    Disallow: /forum/index.php?action=findmember
    Disallow: /forum/index.php?action=help
    Disallow: /forum/index.php?action=helpadmin
    Disallow: /forum/index.php?action=login
    Disallow: /forum/index.php?action=logout
    Disallow: /forum/index.php?action=mlist
    Disallow: /forum/index.php?action=modifykarma
    Disallow: /forum/index.php?action=pm
    Disallow: /forum/index.php?action=post
    Disallow: /forum/index.php?action=printpage
    Disallow: /forum/index.php?action=profile
    Disallow: /forum/index.php?action=recent
    Disallow: /forum/index.php?action=register
    Disallow: /forum/index.php?action=reminder
    Disallow: /forum/index.php?action=search
    Disallow: /forum/index.php?action=theme
    Disallow: /forum/index.php?action=unread
    Disallow: /forum/index.php?action=unreadreplies
    Disallow: /forum/index.php?action=verificationcode
    Disallow: /forum/index.php?action=who
    Disallow: /forum/index.php?theme
    Disallow: /forum/index.php?action=stats;expand
    Disallow: /forum/index.php?action=stats;collapse
    Crawl-delay: 5
    Clean-param: PHPSESSID /forum/index.php


    If you install in a particular folder , change "forum" from above.
     
    humtuma, Apr 22, 2013 IP
  4. donjajo

    donjajo Active Member

    Messages:
    14
    Likes Received:
    0
    Best Answers:
    1
    Trophy Points:
    51
    #4
    I suggest you use Optimus Brave mod. A very use SEO tool for SMF
     
    donjajo, Nov 9, 2013 IP
  5. Svoboda

    Svoboda Well-Known Member

    Messages:
    168
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    123
    #5
    I always recommend to ask and get these from the official support forums. Odds are you'll get the best answer there since they are the subject matter experts. If you don't get a solid answer, look around for one of their big boards that places well in Google rankings and then take a look at theirs.
     
    Svoboda, Jun 30, 2017 IP