Can't understand about robots.txt

Discussion in 'Guidelines / Compliance' started by indrianto, Nov 11, 2010.

0
  1. #1
    Hello DP member,
    I need help about robots.txt for adsense crawl my site.
    I've change my robots.txt become :

    But, for 2 days, the ads not show up in my site, especially when we enter from google. Is this normally due to crawl process or are anything wrong in my robots.txt.

    I've read the instruction on the

    https://www.google.com/adsense/supp...&sourceid=aso&subid=ww-ww-et-asui&medium=link

    Pls anyone give me any suggestion, how the way for ads show-up again. THANKS
     
    indrianto, Nov 11, 2010 IP
  2. spyka

    spyka Greenhorn

    Messages:
    90
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #2
    You don't want anything after the Disallow: bit, otherwise you're blocking the bot from the root of your website
     
    spyka, Nov 13, 2010 IP
  3. indrianto

    indrianto Active Member

    Messages:
    285
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    73
    #3
    Okay, thank you so much....
     
    indrianto, Nov 14, 2010 IP
  4. BB-OM

    BB-OM Member

    Messages:
    371
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    35
    #4
    If you're not an expert, don't even touch the robots.txt file as it can have a lot of negative impact if not configured properly.
     
    BB-OM, Nov 16, 2010 IP
  5. alamcorp

    alamcorp Peon

    Messages:
    18
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    i'm newbie...what function robot.txt?
     
    alamcorp, Nov 16, 2010 IP