GWT "Fetch as Googlebot" VS ordinary Gooblebot

Discussion in 'Google' started by Veal, Aug 26, 2011.

  1. #1
    Hi, I need to recognize if website is viewed by ordinary Googlebot crawling the web or by Google Webmaster Tool's "Fetch as Googlebot" function.

    There is no difference in user agent etc., my first idea was to determine GWT FaG IP's but it's using the same addresses as normal Googlebot.

    So... Are there any schemas of crawling the web which Googlebot uses? Have you any ideas how recognize if it is regular crawling or just "test visit" by GWT?

    I need it to make a 3rd party script counting Googlebots visits excluding those from GWT. Thx for any ideas.
     
    Veal, Aug 26, 2011 IP
  2. sjnewton

    sjnewton Peon

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    I have a statcounter code on my website and my stats either list the visits as Googlebot or Google Webmaster.
     
    sjnewton, Aug 27, 2011 IP