Is this an AOL spider visiting my site?

Discussion in 'All Other Search Engines' started by tomd, Feb 13, 2006.

  1. #1
    Over a 15 minute period yesterday, I received numerous visits from a "proxy.aol.com" domain. Is this the aol.com search engine indexing my site?

    Following are exact machine names and visit times:

    12 Feb, Sun, 13:43:31 cache-dtc-ae01.proxy.aol.com
    12 Feb, Sun, 13:43:37 cache-los-ac08.proxy.aol.com
    12 Feb, Sun, 13:43:43 cache-los-ab09.proxy.aol.com
    12 Feb, Sun, 13:44:41 cache-dtc-aa02.proxy.aol.com
    12 Feb, Sun, 13:48:17 cache-los-aa02.proxy.aol.com
    12 Feb, Sun, 13:48:55 cache-los-ac01.proxy.aol.com
    12 Feb, Sun, 13:52:26 cache-los-ab06.proxy.aol.com
    12 Feb, Sun, 13:53:11 cache-los-ab01.proxy.aol.com
    12 Feb, Sun, 13:53:40 cache-los-ac02.proxy.aol.com
    12 Feb, Sun, 13:57:07 cache-los-ad08.proxy.aol.com
    12 Feb, Sun, 13:58:26 cache-los-ab05.proxy.aol.com
     
    tomd, Feb 13, 2006 IP
  2. mines

    mines Well-Known Member

    Messages:
    1,127
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    160
    #2
    Don't all "normal" AOL users, when using the AOl browser use the aol proxy? Maybe its just a normal user? I'm not sure.
     
    mines, Feb 13, 2006 IP
  3. Hemanth

    Hemanth Active Member

    Messages:
    310
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    60
    #3
    Most probably it's a normal AOL user. As AOL transfers it's users through a series of proxies to the requested page. :)
     
    Hemanth, Feb 13, 2006 IP
  4. tomd

    tomd Peon

    Messages:
    62
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Yes, you are right. I checked the AOL info site for webmasters and they described the same process. Thanks for your help.
     
    tomd, Feb 14, 2006 IP
  5. Hemanth

    Hemanth Active Member

    Messages:
    310
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    60
    #5
    I've added my site to the AOL index & i'm getting the same stats now .. :)
     
    Hemanth, Feb 18, 2006 IP
  6. wny

    wny Peon

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I have seen AOL proxies coming through before and my site still isn't indexed on AOL, so it's apparently common regardless.
     
    wny, Feb 21, 2006 IP
  7. peterstannard

    peterstannard Peon

    Messages:
    166
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #7
    I have a number of links on AOLs search engine. Getting decent traffic. Not as much as the "big 3" though.
     
    peterstannard, Feb 22, 2006 IP