viewing large server logs on windows?

Discussion in 'Traffic Analysis' started by disgust, Oct 24, 2005.

  1. #1
    anyone particularly happy with any individual product? I've got a 2gb log file here I'm trying to view, and I've gone through about 4 programs now and none seem to work for this
     
    disgust, Oct 24, 2005 IP
  2. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #2
    Is there just a section you are trying to view? If so, you might want to spin it through grep first to extract just what you want.

    I think most programs are going to have a problem loading the entire 2GB file into memory at once.
     
    digitalpoint, Oct 24, 2005 IP
  3. dzcap

    dzcap Well-Known Member

    Messages:
    970
    Likes Received:
    41
    Best Answers:
    0
    Trophy Points:
    153
    #3
    So did you find a solution? I need to view some logs too, been loading them in microsoft word and it's taking hours to load?? What other program to use to see the logs?
     
    dzcap, Oct 24, 2005 IP
  4. mystikmedia

    mystikmedia Jedi Master

    Messages:
    5,564
    Likes Received:
    498
    Best Answers:
    0
    Trophy Points:
    270
    #4
    If you mean analyze rather than view, I would recommend WebLog Expert. If you mean view, any good text editor would be fine.
     
    mystikmedia, Oct 24, 2005 IP
  5. mrspeed

    mrspeed Guest

    Messages:
    193
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I have opened up pretty large files in Textpad. You may have to increase your paging file size though.
     
    mrspeed, Oct 25, 2005 IP
  6. disgust

    disgust Guest

    Messages:
    2,417
    Likes Received:
    133
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I've tried everything from textpad to ultraedit to notepad++. nothing seems to want to handle it.

    I ended up splitting the file up and looking at the individual chunks as nothing else was working

    my page file is pretty big- I've got 2gigs of ram so by default it's pretty huge.
     
    disgust, Oct 25, 2005 IP
  7. J.D.

    J.D. Peon

    Messages:
    1,198
    Likes Received:
    65
    Best Answers:
    0
    Trophy Points:
    0
    #7
    What I do is I run Webalizer on a one-day log - this gives me a snapshot of website's activity for the day. Then I pick any interesting bits from the report (e.g. particular host being too busy, particular page requested too many times, particular time range is too busy than any other, etc) and filter the log file based on this criteria. The resulting file is usually much, much smaller than the original. I use sed/grep/findstr for filtering, depending on the platform.

    J.D.
     
    J.D., Oct 26, 2005 IP