Myspace Layouts - Credit Cards - Find jobs - Air Jordans - Debt Consolidation

PDA

View Full Version : googlebot, how to tell how deep the crawl?


cgchris99
Feb 16th 2006, 11:50 am
I have a php based site that emails me when a certain page gets hit by the google bot.

Is there a way I can tell how deep the bot crawls?
Is there any application for this or a log reader?

I have been reviewing the pages indexed by google. We have seen quite a few changes since BD started. Now we have a bunch of supplemental results. When I look at them, a lot are cached from July of 2005.:mad:

thanks for any advice.

Smyrl
Feb 16th 2006, 11:54 am
Monitor you log files.

Shannon

jackburton2006
Feb 16th 2006, 12:42 pm
Your server should have a record of all the bots that have spidered your site. You can trace Googlebot's progress that way.

Jocelyn
Feb 16th 2006, 1:18 pm
Log analyzers will help you with that. It's nice to know that the ten hits were bots that did hit ten pages one time and not just the homepage 10 times...

just-4-teens
Feb 16th 2006, 1:46 pm
do site:yoursite.com/folder and then try site:yoursite.com/folder/folder
and see what results are brought back.

igotdreams
Feb 23rd 2006, 2:36 pm
also the new google sitemaps will give that type of information