1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Analyze large logs

Discussion in 'Traffic Analysis' started by kjewat, Jun 30, 2005.

  1. #1
    Hi.

    Earlier I used awstats to analyze my server logs, but when the logs started to become large awstats used too much resources.

    I then switched to urchin, which sees to be more efficient than awstats.
    But now urchin is using too much resources too :(

    I have log rotation every day and each log is about 200-300 Mb.

    I didn't think a server log of that size should be a problem. But the server load is very high (5-150) when urchin is analyzing it...

    How do you analyze your server log ?
     
    kjewat, Jun 30, 2005 IP
  2. mystikmedia

    mystikmedia Jedi Master

    Messages:
    5,564
    Likes Received:
    498
    Best Answers:
    0
    Trophy Points:
    270
    #2
    I use WebLog Expert. It's excellent. Sounds like you probably use a *nix server, but for Windows servers, you can run it on the server as a service. Works terrific for me. I used to use LiveStats, but it has a major shortcoming that WebLog Expert does not have. You can also use WebLog Expert for *nix servers, but you have to run it locally on your PC then.
     
    mystikmedia, Jun 30, 2005 IP
  3. nddb

    nddb Peon

    Messages:
    803
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #3
    analog is fast. www.analog.cx

    from the site :
    I don't think it uses a lot of resources, I could be wrong, it has lowmem settings and stuff to keep from using too much. You can also nice processes in linux... turn down their priority, man nice.
     
    nddb, Jun 30, 2005 IP
  4. Will.Spencer

    Will.Spencer NetBuilder

    Messages:
    14,789
    Likes Received:
    1,040
    Best Answers:
    0
    Trophy Points:
    375
    #4
    I still use AWStats, but I configured it to roll the logs over.

    Set it up to run once an hour to distribute the processing load.
     
    Will.Spencer, Jun 30, 2005 IP
  5. nddb

    nddb Peon

    Messages:
    803
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #5
    logrotate (should come with most distros) will also rotate logs and zip them, at whatever size you want. Then you can open the zipped logs later if you want to look at them again. Forgot to add that before.
     
    nddb, Jun 30, 2005 IP