I just notice the following in google email upon approval of my application.... Please note that you might not maximize your earnings from AdSense if you have any of the following on your website: * robots.txt * frames * forms and dynamic content * excessive images * login and password requirements Is it true that the robots.txt cause lower income?
Don't know for a fact but I'd expect it to cause problems if you use it to exclude spiders from pages that display ads.
As for robots.txt, I think it means what it contains. Like any restrictions to the g-bot crawling your pages and matching the proper ads to the proper content. Example if you restrict bot crawling, your only ads that might show up are PSA's, which will restrict you income potential. hth, tom
Precisely if you restrict g-bot lets say from a subdirectory on your domain and than try to show ADS on this it'll come up empty (PSA's) The file as such makes no difference. Expat
Its not actually the file itself, but what you put inside it (since were all re-stating the same thing in our own words)
You can have the robot.txt file on your server as long as you don't stop the spider from crawling pages where you display ads. If google will not be able to read your content it will deliver less releavnt or no ads so your earnings will go down.
hi... Often your site may be inaccessible due to broken links and wrong use of robots.text that may cause your pages not indexed by Search Engines. ... If you are struggling to make money online, this is where you'll get the method, the support, and the tools you need to build a sustainable low-maintenance income online.
If you are not sure how to use robots.txt file than by all means do not even make one. A lot of crawlers don't even abide by it anyway. Better off not using one than to fudge up something with google.