Hi there, In the Google Webmaster Account, I found that Google bot visited the home page of a site about 40 days before and no after that. Ever the sitemap has been submitted. I want to know that how to make the bot to visit regularly and frequently. Regards bushib
Have you checked your server logs to confirm that was the true last date it arrived? That data can be seriously off some times. Does your site show indexed pages with the "site:" operator?
Hi there, The site pages can be seen in Google with this operator site:sitename.com. But it also shows some of the deleted pages, which are no more on the host computer. I deleted those old pages approx one and half month before. Regards bushib
Googles webmaster account isn't updated after every crawl. I get crawled daily, but it seems Google only updates stats in the "Google Webmaster Account" whenever it feels like it. Id say every week or two. I run this cgi script occassionally, with an update of every 30 seconds or so, to monitor crawlers. Here is a small cut and paste from one of my sites whichverifys I'm getting crawled, but I know Googles Webmaster account wont be updated for awhile. Good luck though.... PS - I heard of a neat idea called a "spider trap", not sure. You basically create a page on your website with a link on the main page. You use an anchor text for the link of "." or a space, place it somewhere where users wont accidently click it. Than, you can almost assume that any visit to that page is a crawler. Than go here... www.iplists.com and see whos snooping around.. Good luck on your site though! 16:44 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/cabot_pennsylvania.htm REFER: - 16:44 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/unionville_tennessee.htm REFER: - 16:44 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/cherokee-ranch_pennsylvania.htm REFER: - 16:44 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/joliet_texas.htm REFER: - 16:44 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/mi-wuk-village_california.htm REFER: - 16:44 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/thomasville_alabama.htm REFER: - 16:45 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/white-tower_kentucky.htm REFER: - 16:45 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/greenville_kentucky.htm REFER: - 16:45 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/richmondale_pennsylvania.htm REFER: - 16:45 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/zanesfield_ohio.htm REFER: - 16:45 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/mcveytwn_pennsylvania.htm REFER: - 16:45 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/dresden_maine.htm REFER: - 16:45 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/otisco-valley_new-york.htm REFER: - 16:45 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/n-lewisburg_ohio.htm REFER: - 16:45 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/seal-harbor_maine.htm REFER: - 16:45 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/chipmans-point_vermont.htm REFER: - 16:45 HOST: crawl-66-249-66-20.googlebot.com URL: /weather/elgin_texas.htm REFER: -