GoogleBot for Forum

Discussion in 'Google' started by HWMF, Aug 27, 2013.

0
  1. #1
    To get a better (but also safe) improvements in Google Search or Google Images, what do you certainly need to Allow and Disallow in Robots.txt for your Website/ Forum?

    Thanks in advance!
     
    HWMF, Aug 27, 2013 IP
  2. felomeno

    felomeno Peon

    Messages:
    8
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    1
    #2
    Hello,

    I get almost 90% of my traffic from Google (around 50 k unique visitors per day) and this is what my robots.txt looks like

    User-agent: Mediapartners-Google*

Disallow:

User-agent: *
Disallow: /wp-admin
Disallow: /wp-login.php
Disallow: /*/feed
Disallow: /*/trackback
    Code (markup):
    I'm running Wordpress and vBulletin on this site.

    Hope it helps!
     
    felomeno, Aug 27, 2013 IP