Problem finding robots.txt file

Discussion in 'robots.txt' started by Web Idiot, Oct 29, 2009.

0
  1. #1
    I have a problem with a Wordpress site that is not showing my adsense ads. Upon further investigation I noticed the robots.txt file was disallowing the bots to crawl the site! Or am I wrong? Hopefully someone can help me fix this problem because I cant find this file on my server to modify.

    http://www.sweettemplates.com/robots.txt

    Thanks in advance for your help
     
    Web Idiot, Oct 29, 2009 IP
  2. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #2
    Your robots.txt code is
    User-agent: *
    Disallow: /

    That means you have blocked crawlers to access your whole website. To avoid this problem use:

    User-agent: *
    Disallow:
     
    manish.chauhan, Oct 29, 2009 IP