Here's some things I put in my robots.txt for my smf forum. User-agent: * Disallow: /*sort=* Disallow: /*msg* Disallow: /index.php?action=activate Disallow: /index.php?action=admin Disallow: /index.php?action=calendar Disallow: /index.php?action=emailuser Disallow: /index.php?action=findmember Disallow: /index.php?action=help Disallow: /index.php?action=helpadmin Disallow: /index.php?action=login Disallow: /index.php?action=logout Disallow: /index.php?action=mlist Disallow: /index.php?action=modifykarma Disallow: /index.php?action=pm Disallow: /index.php?action=post Disallow: /index.php?action=printpage Disallow: /index.php?action=profile Disallow: /index.php?action=recent Disallow: /index.php?action=register Disallow: /index.php?action=reminder Disallow: /index.php?action=search Disallow: /index.php?action=theme Disallow: /index.php?action=unread Disallow: /index.php?action=unreadreplies Disallow: /index.php?action=verificationcode Disallow: /index.php?action=who Disallow: /index.php?action=stats Disallow: /index.php?theme Disallow: /attachments/ Disallow: /avatars/ Disallow: /Packages/ Disallow: /Smileys/ Disallow: /Sources/ Disallow: /Themes/ Disallow: /index.php?*;wap Disallow: /index.php?*;wap2 Disallow: /index.php?*;imode
No problem. I can't count how many times I've seen the "wap" and "wap2" versions of someones smf forum or specific thread ranking higher in Google than their actual forum/specific thread. So it's good to disallow it in robots.txt
Do I put that in the same directory as the forums? MY main site (top directory) is not the SMF forums but I have the forums in a different folder. This is why I am asking. Hope to hear an answer soon as I am annoyed especially by the bots that get by SMF security and register and wait a week and then change their signature to spam links. Thx.