robots.txt question

Discussion in 'AdSense' started by greenflag, Mar 5, 2011.

  1. #1
    does anyone think you need this entry in robots.txt?

    User-agent: Mediapartners-Google
    Allow: /*
     
    greenflag, Mar 5, 2011 IP
  2. navin_bvr

    navin_bvr Active Member

    Messages:
    211
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    90
    #2
    navin_bvr, Mar 5, 2011 IP
  3. greenflag

    greenflag Active Member

    Messages:
    369
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    51
    #3
    so do you think it helps with adsense relevancy?
     
    greenflag, Mar 5, 2011 IP
  4. ForgottenCreature

    ForgottenCreature Notable Member

    Messages:
    7,473
    Likes Received:
    173
    Best Answers:
    0
    Trophy Points:
    260
    #4
    You don't need it. And it doesn't help with relevancy/
     
    ForgottenCreature, Mar 5, 2011 IP
  5. shakac

    shakac Peon

    Messages:
    41
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    if you have copied contents then replace allow with disallow to escape from google robots.like my site downloadzone2.com/robots.txt
    it increase your site traffic else your site must be banned.
    if you do not have copied contents it do not need
     
    shakac, Mar 9, 2011 IP
  6. music legend

    music legend Well-Known Member

    Messages:
    1,322
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    180
    #6
    if its not in your file the bot still has permission so no its not really necessary but its good to allow either way
     
    music legend, Mar 9, 2011 IP