hi to all! im doing some SEO, but i dont understand something, i keep track of google bot every day in my awstats and i notice that he comes by gives me over a 1000 hits and download 40megs and more everyday, i also noticed that everyday he gives more and more hits and downloads more megs this is the first time i do SEO. is it good that gbot downloads that much?
That is what GoogleBot does, it crawls your site over and over and over and if you keep adding new content it will end up using more resources to crawl your site. This is why people limit their crawl rate or prevent Googlebot from crawling certain sections of their website.
I have one more question adding to this: for example in Lithuania everyone uses Google, so should I block MSN and yahoo from crawling my site? Would that help saving some traffic?
Nope, MSN & Yahoo can still provide your site with organic traffic, they also aren't as resource hungry as Google Bot.
Beware. Google Bot is large and in charge. I doubt even Godzilla or the Cloverfield monster could take it on.
I cant prove this, but it seems that the more G crawls, the quicker you get listed. I have a newer site that G crawled 300 megs of this month, 250 last month. I want to see more crawls next month (Feb). I have a 150k - 250k page site I'm very anxious to get listed. Starting to sporadically show up. I had another large site before and it took forever to get crawled and listed. Seems like the more pages, the longer it takes. Good luck though, sounds like you have a very large site. Just give it some time!
There is an error in your site probally and the Google ball is a bouncing and trapped. PM Sweetfunny He is good at this sort of stuff
for example: my awstats say that google gave me 1200 hits yesterday and 40,50mb downloaded, today google gave me 1479 hits and downloaded 46,89mbs Keeps on growing everyday
are you talking about the site in your sig? that is not original content, is it? do you actually have human trafic from google or only googlebot comes? you have many subpages, that's why you get so many hits
i normally have about 60 visitors from google everyday on the site that we are talking about, and google bot pays me a visit everyday