if anyone knows, how long spiders/googlebot/adsensebot crawling on a single page of a web ? 3 second ? 10 sec ? 15sec? 30sec ? or maybe 60sec? or it's depending on how many content/words from the page? i specific the question like: how long the spider crawling on a single page content with 500 word of a web?
I agree, webmaster tools will help you when your site is crawled and what pages are indexed. It will also help you identfy the position of your keywords.
Its not dependent on time or the word count. It's the memory size of the page that matters in crawling a webpage.
it really depends on how search engine friendly your site.. that's why google have this guidelines that can help to index site..
Don't know if this crawling relates to the Matt cut's topic about speed of site. But surely clear and clean site code structure that shows the contents easily would help Google bots index completely a page and that won't take long..
do bookmarking on high pr(7+) sites. update your site content. register in google webmaster tool. google index the bolg in less time so post the comments in blog.
Most probably it should be depending on how is your page appearing in front of the bot. The bot must have been set alongwith all the rules and regulations of google indexing. If the page is perfect, it might be staying for a longer time than others.... Just a thought, not sure about it.
What I think since the spider is only a robot, it simply randomly chooses the site that it would want to index. We can't control a robot and it simply does what it was programmed for it to do.
He actually wants to know "For how much time does a Google spider stays on a single page" I think it is just a matter of few seconds ( even a fraction if your servers are fast ) It does depend of the size of text only version of your webpage, because googlebot reads your pages as text only. Means it does not download images, videos and other rich media, if we simply do not talk about some of the latest enhancements, including ability to read flash. But I am sure Google does not read the flash on a website unless it feels the website worthy of it. So, it depends on the length of your code rather than number of words. And it depends much more on the speed of the server of your hosting at that time. I will say a fraction of seconds. P.S. I checked my webmaster tools stats and it says that 2100 pages crawled in roughly 800 seconds. It means 0.38 seconds for 1 page. Regards Parul Sharma
I don't have any idea about that.. Ya i think in webmaster tools there is something mentioned about that..
I think it depend on various factor Like 1) Your Server Speed 2) Your Site Page Load 3) Site Link Navigation and many other thing google count when google crawl your site..
i think you dont understand my question is. im not asking how long to index, im asking how long the spider stay in single of page of our web. yes, i agree with this answer. but is there anybody know the time (sec, minute) the spider crawling. maybe some google engineer read this thread and give us an answer.