Robots.txt file

Reason Blocked [?]
Robots.txt

Does this stop my adsense account from gaining revenue off that particular site that is blocked off of?

Excuse this, if it has been asked 100 times

 

if the site is blocked you can still gain revenue from adsense, your site just won't be indexed by google so unless you have other secure sources of traffic it will probably be a lot harder to make money.

I have to ask though, why would you block your whole site?

 

Thanks for your fast response and the answer to the question.
One of my forums loaded too slow, because of all the many bots, I disabled it and it ran much faster

 

ok fair enough

although i'd recommend you still allow the googlebot. you can do so by just adding this to your robots file

User-agent: *
Disallow: /

User-agent: Googlebot
Disallow:

Code (markup):

this will block everything else apart from te googlebot

 

The AdSense crawler isn't Googlebot, and the indexation of pages has nothing to do with AdSense.

The correct robots.txt syntax to disallow all bots BUT the AdSense bot is :

User-agent: Mediapartners-Google*
Disallow:

Code (markup):

https://www.google.com/adsense/support/bin/answer.py?answer=10532

 

i was just saying to allow googlebot at least for traffic purposes.... wasn't actually aware that there was an adsense bot and that would be blocked too ...good to know

 

Adsense will show ads on those pages that center around the general theme of your site. Adsense is programmed very well and has forseen situations like this.

 

Yes, that's it.