Where do bots and spiders collect a websites stats. and traffic from?

Discussion in 'Traffic Analysis' started by langleau, Mar 18, 2008.

  1. #1
    A silly question I guess (please forgive me I'm still in the early learning stages) - it has intrigued me for sometime now as to if bots and spiders are seeing the same traffic and stats. information as we do or not?

    Do they have access to the same information as the sites Cpanel or do they collect information from somewhere else.

    I apologise if I have posted in the wrong forum for this. If I have someone might point me in the right direction.

    Thanks and cheers.
     
    langleau, Mar 18, 2008 IP
  2. joebert

    joebert Well-Known Member

    Messages:
    2,150
    Likes Received:
    88
    Best Answers:
    0
    Trophy Points:
    145
    #2
    Usually from unprotected access logs or a sites popularity in search engines.

    Occasionally if you look for the right terms you can find interesting information about keywords.
     
    joebert, Mar 18, 2008 IP
  3. langleau

    langleau Peon

    Messages:
    233
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Thanks for your reply.

    Do you mean that they can get access through your actual control panel as well (I hope that this all makes sense).
    What sort of data do they extract from there?

    Thanks again and cheers.
    Suzanne.
     
    langleau, Mar 18, 2008 IP
  4. joebert

    joebert Well-Known Member

    Messages:
    2,150
    Likes Received:
    88
    Best Answers:
    0
    Trophy Points:
    145
    #4
    They don't need to go through a control panel most times, with stats applications like Awstats & Webalizer anyone can look at the stats if the know the address alot of times.

    It's just a matter of the stats reports being saved in public directories & people knowing the naming pattern used by the application doing the stats reporting.
     
    joebert, Mar 18, 2008 IP
  5. langleau

    langleau Peon

    Messages:
    233
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Very informative - thanks for your help.
    Cheers.
     
    langleau, Mar 18, 2008 IP
  6. TechnoGeek

    TechnoGeek Peon

    Messages:
    258
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #6
    As long as I know, bots and spiders (they are the same thing) don't collect any traffic information. Please enlighten me.
     
    TechnoGeek, Mar 18, 2008 IP
  7. scorpion14

    scorpion14 Peon

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Your sitemap submitted helps in reading the statistics..
     
    scorpion14, Mar 18, 2008 IP
  8. joebert

    joebert Well-Known Member

    Messages:
    2,150
    Likes Received:
    88
    Best Answers:
    0
    Trophy Points:
    145
    #8
    Now with spiders like Googlebot, MSNBot, Alexa, etc, that info usually comes from toolbars installed on peoples' computers which monitor what the person visits and sends anonymous statistics back to central servers. These larger companies usually share/sell this information amongst themselves.
     
    joebert, Mar 19, 2008 IP
  9. langleau

    langleau Peon

    Messages:
    233
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Thanks Joebert,

    Your info. has been helpfull and is more than appreciated.

    Cheers.
     
    langleau, Mar 19, 2008 IP