I noticed my server was running a little hot so I started poking around in the logs. My site is currently getting flooded with traffic from GoogleBot. Googlebot is using my sites built in search and is plugging in words. Going back, it looks like it has been doing this for days and it is gaining speed. Has anyone else seen this before?
You mean it uses your search form to make searches? what kind of words/keywords is the google bot using?
You mean Googlebot searches for a word on your site and then indexes that page? If so, it happened to one of our site too (from google and yahoo). Don't know what to make of it though.
Wouldn't it be an idea to use the robots.txt to stop access to you search page? Also, placing this at the top of you robots.txt will slow down the rate that Googlebot hits your website: User-agent: * Crawl-delay: 5 Code (markup):
I've seen this happen as well. Google's getting more aggressive in auto-filling out forms and such. See here: http://googlewebmastercentral.blogspot.com/2008/04/crawling-through-html-forms.html
I have never experienced or seen people talking I agree with Divisive Cottonwood put it in your robots.txt and it will slow down
I have my website www.styledesign.in .. The day before yesterday google pagerank was 3 Yesterday pagerank was 4 and now today my pagerank is just 2 I dont understand how my pagerank changed.. why google did this??
I doubt they did. the PR that's publicly available is both crude and almost always out of date. The fluctuations you see are probably due to whatever method you're using to check it using different data centres.
well google has the results from a search on my page in the rankings, that means it had to do the searches sometimes.... Some results are also in the site links at the google results page...
If it is ok to block googlebot from crawling your site's search function, then why not you block it via robots file? I have blocked googlebot from accessing my forum search function.
Mostly resources, I had to do some quick tuning to the mysql database so that the load would go down. What is funny, once I did that, the speed of inquires increased..
i dont think that goolge need any bot for their systems if this will happen so google bot wil give them automatic ranking without any traffic
Very interesting, does that mean Google is actually using the search function to find pages to index then?
I hope so... I track the number of pages listed in a spreadsheet, I will have to compare over the next few days.