Adsense report for the past 15 days showed a lot of stuff like these: Blocked URL: http:/ / webcache. googleusercontent. com/ search? blah blah blah Reason blocked: Robots.txt But my robot.txt file only has the following 6 lines of text, which validated well with Crawler Access Tests in Google Webmaster Tools for 3 bots as below: User-agent: Mediapartners-Google* Disallow: User-agent: Adsbot-Google Disallow: User-agent: Googlebot Disallow: Any idea? Thanks.
With your robots.txt you block Adsense spider to crawl your site. Why would you do that if you use adsense? either use: Allow: / or remove all entries completely
Thanks for your suggestion. That has been the code for my robots.txt for quite sometime now & my site is getting relevant ads, but it's only lately that I've been seeing those errors in Adsense report. Will try removing all lines of code anyway, and see if that puts an end to those errors.