Hey, Is it possible to ban googlebot and still allow adsense to display their ads? I just banned googlebot a few months ago due to a few reasons... and I wanted to use adsense again this month... but it looks like adsense will display PSA's if you ban googlebot. Is there a way around this? I am not trying to do cloaking or any illegal and against Adsense TOS... I just want to ban googlebot and still dsiplay Adsense banner.... I am willing to pay a few bucks to who ever can help me with this! I really need this done. Thanks in advance!
you can easily block googlebot using your robots.txt just add User-Agent: Googlebot Disallow: / This will only block googlebot, there are google bot for images, and adsense..
Hi eli03, I don't think you have read my post clearly... I know how to ban googlebot... what I am asking is how to show Adsense banner even if you ban googlebot or if there is a way around it.
You can ban google bot if you like, but if you want to display ads you don't have to ban Google Adsense Bot. It's not the same bot, Google has many bots.
To protect my content from getting indexed in google as simple as that. I have allowed googlebot in my / or root folder and not in my restricted pages, but I want to add adsense banner in those pages too!
or why dont you use authentication so that google does not index your site but adsense will allow your site!!
Hello, You have a point! I actually have read about it too! This is the example: user-agent: mediapartners-google* Allow: /blahblah/ User-agent: * Disallow: /blahblah/ Disallow: /hmmmm/ Disallow: /blehbleh/ I already have tried this.... and so far my Adsense is displaying paying advertisers and not PSA's.... However with this robots.txt the contents of /blahblah/ are still indexed by googlebot... which is very "OPEN" to the public especially google.com I only want the mediapartners or adsense bot only to crawl that certain page...
The best and safer way is authentication! As the adsense allows authentication while search engines cannot. They prompt with the index page only! so you can also protect your content and also earn through adsense!! Also if you have banned bot already you should remove and wait for some time to check whether it is enabled in the adsense acc!
I just found this page: Your site has restricted access using a robots.txt exclusion. If your site is using a robots.txt file, the AdSense crawler may be blocked from crawling your webpages. Therefore, we may not be able to serve you the most relevant ads based on the content of your website. On pages where we are unable to crawl or understand the content of a page, public service ads may be displayed. If you would like to grant our crawler access your pages, you can do so without granting permission to any other bots. Simply add the following two lines to the top of your robots.txt file: User-agent: Mediapartners-Google* Disallow: I am thinking that the code "Disallow:" will disallow all bots! but where is the part that allows adsense crawler bot? I was thinking differently... Below is my own robots.txt I made it up... user-agent: mediapartners-google* Allow: /blahblah/ User-agent: * Disallow: /blahblah/ What is the difference of my robots.txt to what google is saying?
the google robots.txt says only not to disallow mediapartner-google while they dont say anyother bots to disallow They expect you to add the list of bots after Disallow : which is far difficult !!
If this does not work you can block the user agent of your choice in ht access. There is another bot for Adsense so you should be ok. Are you saying you already did block Google Bot and were getting public service ads?