How can I tell if bots are crawling my proxies?

Discussion in 'Site & Server Administration' started by Mysmasken, Nov 29, 2007.

0
  1. #1
    Hi, I have 5 proxies running and I had to upgrade my server from 256RAM to 512RAM today, because it crashed due to lack of RAM.
    I checked in a few minutes ago and I'm already using 96% of those 512RAM :eek:

    The host told me to make sure I have a proper robots.txt (which I should probably ask about in that forum), but other than that, what is sucking up all that RAM? And how can I tell who's been on my site? (I'm using Google Analytics).

    Also, what specs do you recommend for running around 50 proxies?
    How much RAM would be needed?

    Thanks

    Stephanie
     
    Mysmasken, Nov 29, 2007 IP
  2. agnivo007

    agnivo007 Peon

    Messages:
    4,290
    Likes Received:
    289
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Maybe you're on a VPS. These are not good for proxies with traffic...dedi server is the way to do for many proxies with traffic.
     
    agnivo007, Nov 30, 2007 IP