Tools to measure spider visits

Discussion in 'Search Engine Optimization' started by Mitchelle Johnson, Aug 1, 2008.

  1. #1
    Is there any tool to measure spider visits?
     
    Mitchelle Johnson, Aug 1, 2008 IP
  2. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #2
    astup1didiot, Aug 1, 2008 IP
  3. T_Media

    T_Media Peon

    Messages:
    691
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #3
    If you want to track Google bot exclusively you can just use Google Webmasters tool which will tell you when the last time Google crawled your site was.
     
    T_Media, Aug 1, 2008 IP
  4. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #4
    You do realize that data isn't current and doesn't efficently tell you the last crawl attempt, I see GoogleBot daily on my sites but GWC doesn't update.
     
    astup1didiot, Aug 1, 2008 IP
  5. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #5
    You do realize that data isn't current and doesn't efficently tell you the last crawl attempt, I see GoogleBot daily on my sites but GWC doesn't update.
     
    astup1didiot, Aug 1, 2008 IP
  6. T_Media

    T_Media Peon

    Messages:
    691
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #6
    @ssandecki, Thanks for the heads up, I had honestly not noticed this before.
     
    T_Media, Aug 1, 2008 IP
  7. Trusted Writer

    Trusted Writer Banned

    Messages:
    1,370
    Likes Received:
    52
    Best Answers:
    0
    Trophy Points:
    160
    #7
    More than tools there are PHP scripts that detects any robot or spider crawling your site and then writing a log on your web space or delivering an email each time each visit occurs.
     
    Trusted Writer, Aug 1, 2008 IP
  8. cnvseo

    cnvseo Guest

    Messages:
    355
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #8
    yes, in google webmaster tool you can find one Statistics section, in this you can find Crawl stats options as well also index states option.

    Find graph of crawling stats of google spider on your site.
     
    cnvseo, Aug 2, 2008 IP
  9. genuineseo

    genuineseo Well-Known Member

    Messages:
    783
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    108
    #9
    yes use Google Webmasters tool you can find index states.
     
    genuineseo, Aug 2, 2008 IP
  10. harvestre08

    harvestre08 Banned

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    google webmaster will help a lot in that case.
     
    harvestre08, Aug 2, 2008 IP
  11. sweetfunny

    sweetfunny Banned

    Messages:
    5,743
    Likes Received:
    467
    Best Answers:
    0
    Trophy Points:
    0
    #11
    For a blog, Patrick over at Blogstorm created this Wordpress Crawl Rate Tracker plugin that displays crawl graphs etc for your blogs pages.

    I've been using it for a while and it's quite good.
     
    sweetfunny, Aug 2, 2008 IP