How Do I find if google bot is visiting my site?

How do I find when google bot is visiting my site? Is there any way to check that out?

 

Your CPanel web logs should do.

 

Thats if you have Cpanel.

If you do simply go to the 'Latest Visitors' tab or Webalizer and that will tell you

 

if your site is developed in php add this/customise this code to check google and yahoo bots visit

<?php
$email = "youremail@youremail.com";

if(eregi("yahoo! Slurp",$_SERVER['HTTP_USER_AGENT']))

{

mail($email, "The Yahoo bot came to call yoursite",

"Yahoo has visited: ".$_SERVER['REQUEST_URI']);

}

if(eregi("googlebot",$_SERVER['HTTP_USER_AGENT']))

{
mail($email, "The Googlebot came to call your site",

"Google has visited: ".$_SERVER['REQUEST_URI']);
}
?>

 

Google webmaster tools tell you everything. Didn't you know?
Webmaster tools even let you know how many byte did google download from your site.
Every details there, you can't miss that .
another way is sooribabu 's php code.

 

i usually use cpanel > awstats and there's a section to indicate last visits and how many times your robots.txt file has been hit.

 

put stat counter into your website and check it

 

You can use google webmaster tools to see when google bot visited your site. I saw somewhere in this forum that we can also see google bot via google analytics. I suggest you search for some details, may be you will find the way to use google analytics to see google bot.

 

You should get a Google Webmaster Tools account, if you haven't already.
http://www.google.com/webmasters/tools/

That will give you stats on Google's crawls of your web site, plus lots of other information.

I don't think Google Analytics has that data, since the bots don't execute the javascript used for tracking.

 

this is check your cpanal

 

my preferred method in addition to correct below methods is to download ( and save for 1+ yrs ) all access_log files for offline-processing by suitable software.

any decent available offline log analyzer tool gives you stats for bogs.
the offline method has the advantage to have all access data on hand in case of security problems. for that reason I also keep access_log files for up to a year or longer. to have back in time data for in depth research if needed. I needed - you'll need as well sooner or later!

 

1. Cpanel web logs
2. Statcounter
3. analytics
4. web master tool

 

you can try through Cpanel web logs or analytics.

 

Google Webmaster Tools is a good start and as the previous poster mentioned Analytics can also give a good indication if the search bots are crawling your pages as it can be displayed in the 'Content' tab of most popular pages (if its gaining visitors its a good indication that the pages are indexed)

 

If your website is integerated with Google Analytics, you can check it at Visitors > Browser Capabilities > Browsers

You can also check it through Google Webmaster Tool.

Cheers..

 

You can use Google Webmaster Tools and after you can observe when Googlebot visited your site

 

I use google webmaster tools and thats pretty much it..

 

just check google last cache date of crawl page

 

www.googlebotlog.com

googlebot crawling activity logging

Add your site and your site crawling activities of the Save All Spiders Bot, Online Check

 

Lol! Thats the easiest way to fill your inbox if you include it in all pages and there is a lot of crawler activity.

As many have already mentioned, Web server logs are the best (may not be easiest) way to see the crawler activity.

If you can get a day's log or something simply search for Googlebot in it.