I usually see Googlebot index a couple pages then leave. But the last few days. It has been yummin' up my sites all day long. Is anyone else seeing this?
I'm beeing deepcrawled too... Maybe the is some kind of update in the way... Maybe a backlink update... Who knows?
It facinates me the way so many folks seem to obsess over their logs. I look at my stats at the end of the month to get some idea of how my site is performing.
Next time googleboy comes around, can you tell him to pay me a visit. I'll leave the door open for him. He's been coming around a lot but only grabbing a few pages and then running away.
If you look to them more a few times per week you will see what users are searching and where are they landing. This will give you the opportunity to publish more content on the same issue they are searching, giving them more choice and giving you more happy visitors and more money... Of course, I am talking about a informative website with lots of content and no forum whatsoever, so if you have good content they will come back And Google is in the process, crawling your pages and allowing them to rank high in SERPs for some ninche keywords or other high competitive ones
Without looking at your forums, do you have a link on your members profile page to the topics they've started or posted in? Before I disabled them from public view the bots seemed to use that route often. Just a seggestion.
I also am seeing deep crawl but unfortunately still not seeing the cache updated in search. How does it work? How long after the crawl will g's index be updated?
I had a long discussion just yesterday with a friend that has been doing the SEO for around 5 years. He told me that when Googlebot hangs around for a long time, it is usually not good. Its looking for duplicate content and crap, scraper pages, etc... He explained the reason why (just before the next major update) you see tons of crap in google at the top of the heap. He surmised that google moves all the junk to the top and basically skims it off at the next major update. He claims that the major updates take place every 3 months. The next one he tells me is March. Whether this is all true or not, who knows. It was an interesting and informing conversation none the less.
Generally (as I understand it) googlebot determines how deep and how much to crawl based on PR. The larger the PR, the deeper the crawl. If he is in and out, I would consider that a pretty good sign. If he hangs around, I would get a little worried.
That's kinda interesting, but even more scary. Any data to back up the claim? I've never really paid THAT much attention to a bot crawl. Usually I think "hmm...Google is crawling my site again...cool". Maybe it's time to start mapping out frequencies. Any other members notice a long visit = hand slap by the bots?
No, no evidence. Just what someone told me. He's been doing this for 5 years now, and is very paranoid about everything. The "S#it floating to the top" stuff seems to make perfect sense though.
There's a list somewhere (I'll have to dig it up) on all the past dates for Google backlink and pr updates. It's fairly easy to see patterns and right now is the time I generally see increased robot activity prior to a backlinks update. There's usually a one to two week lag time on that. It doesn't really do any good to speculate on major changes and whatnot, that tends to only cause frustration and hearthache. If I can find my bookmark for the list I'll post it.
2 things I have noticed, the keyword checker shows no changes today, It always does for my keywords even if it is a small plus or minus. And the sencond thing in the mcDar tool was two times in the past days there was a 0 backlink count on one datacenter, and one time there was a 0PR on the same datacenter. Ususally its 5.