If i restrict google bot?

My site is very new. About 2 months old. Today I found that Google bot has increased the number of visits to my site. Now it is about 200 visits per day. However, now it is consuming lot of bandwidth. Is it ok if I restrict some pagers using robot.txt? Will it affect my PR?

 

I would not block _any_ robots, it will probably affect your PR.
But in my limited experience Google will slow down the visits eventually.

Are you sure that the Google bot is eating so much of your bandwith? I mean even 200 visits a day cannot be that much really.

FFMG

 

<meta name="revisit-after" content="5 days">

^^ Add it to your pages.

 

Does Google actually follow this tag?

FFMG

 

Let Google have its way with your site. How much bandwidth is it taking up?

 

Hi,

How do you count these 200 visits ?

First of all, it does not make much sense to speak about the "visit" of a robot. It would be more useful to look at the number of hits and at the bandwidth.

Secondly, there are several Google's robots. If you publish AdSense ads, you get many hits from Mediapartners-Google/2.1. You need them for your ads. The information collected by this robot is used to tune the AdSense ads to the contents of your pages, but it is also available to the search engine. The other main Google's robots are Googlebot/2.1 (+http ://www.google.com/bot.html) and Mozilla/5.0 (compatible; Googlebot/2.1; +http ://www.google.com/bot.html).

The "revisit-after" META tag is not used by modern search engines.

Jean-Luc

 

I'd want them there as much as possible at least until the next update. You should let it ride until then. Should be soon.

 

I just used my Awstats report for this month. Google bot hit 11266 times
it says
Googlebot | 11266+55 | 159.29 MB | 29 Jun 2006 - 05:51
MSNBot | 1871+257 | 96.13 MB | 29 Jun 2006 - 04:46
Inktomi Slurp | 987+535 | 26.19 MB | 29 Jun 2006 - 06:02
hits from unknown robots 15214 bandwidth 438.26 mb
...

respectively
12 different robots*| Hits | Bandwidth | Last visit

also I do not use adsense or have no xml sitemaps.

 

The number of hits from Googlebot will be proportional to your total number of pages and to the importance they have for Google.

If your pages are considered important by Google, Googlebot will visit them more often and they will appear higher in the SERP's.

159.29 MB during a month should not be a problem in most hosting environments. You could also relate this number to the number of visitors you get from Google in a month and compare that with the bandwidth required by other search engines and the number of visitors they bring.

Jean-Luc