Bandwidth problems

Discussion in 'Site & Server Administration' started by xxsAm, Jul 28, 2007.

  1. #1
    Well my proxy network is expanding very quickly, and the cost of bandwidth is killing me($.10/GB) Right now my proxy network is using around 200GB a day. I'm wondering what some solutions to this problem would be. Compression? Cacheing? Anyone else have any ideas, please share. Thanks! ~Sam
     
    xxsAm, Jul 28, 2007 IP
  2. agnivo007

    agnivo007 Peon

    Messages:
    4,290
    Likes Received:
    289
    Best Answers:
    0
    Trophy Points:
    0
    #2
    You should try unmetered 100Mbps dedicated servers from european providers. As for proxies, you can marginally decrease used bandwidth through compression/limiting, but that's not a proper solution.
     
    agnivo007, Jul 28, 2007 IP
  3. xxsAm

    xxsAm Active Member

    Messages:
    464
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    60
    #3
    Who would some of those providers be and what is the cost I would be looking at?
     
    xxsAm, Jul 28, 2007 IP
  4. agnivo007

    agnivo007 Peon

    Messages:
    4,290
    Likes Received:
    289
    Best Answers:
    0
    Trophy Points:
    0
    #4
    agnivo007, Jul 29, 2007 IP
  5. xxsAm

    xxsAm Active Member

    Messages:
    464
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    60
    #5
    I read the reviews on them so I think I'll stay away. To be honest, I absolutely love SoftLayer, and would like to stay with them. How much would enabling compression within index.php of PHproxy help?
     
    xxsAm, Jul 29, 2007 IP
  6. wragge11

    wragge11 Guest

    Messages:
    2,222
    Likes Received:
    47
    Best Answers:
    0
    Trophy Points:
    0
    #6
    You could sell the proxies ;)
     
    wragge11, Jul 29, 2007 IP
  7. agnivo007

    agnivo007 Peon

    Messages:
    4,290
    Likes Received:
    289
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Enabling compression will jack up the load on your box. Sometimes output can be compressed to 30%, based on the content of the page in quesiton.

    Well, there are many more unmetered providers too...just hunt around at WHT :)
     
    agnivo007, Jul 29, 2007 IP
  8. thsadmin

    thsadmin Notable Member

    Messages:
    4,889
    Likes Received:
    133
    Best Answers:
    1
    Trophy Points:
    240
    Digital Goods:
    2
    #8
    We are having a similar issue, finally got traffic, visitors, members and the rest, now we are killing our dedicated server and are asking the same questions, we were wanting to cluster servers but apparently it aint that easy and can be expensive to set up.
     
    thsadmin, Jul 29, 2007 IP
  9. InFloW

    InFloW Peon

    Messages:
    1,488
    Likes Received:
    39
    Best Answers:
    0
    Trophy Points:
    0
    #9
    This sounds like your proxy is getting hotlinked. I setup a proxy to test it in our hosting environment and after a few weeks I found it using 60mbit constant only to notice sites were using it to link images and such. Get rid of hotlinking and I predict the problem will go away.
     
    InFloW, Jul 29, 2007 IP
  10. agnivo007

    agnivo007 Peon

    Messages:
    4,290
    Likes Received:
    289
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Yes that's a possibility...latest phproxy has hotlinking protection built-in :)
     
    agnivo007, Jul 29, 2007 IP
  11. xxsAm

    xxsAm Active Member

    Messages:
    464
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    60
    #11
    At the top of my index.php it has the author info and it states:"Last Modified | 5:27 PM 1/20/200"

    Am I using the latest version? It has the "'allow_hotlinking' => 0," option on it, and i checked through all my proxies and none of them have it set to 1(enabled). Is there a way for people to bypass this and hotlink anyway?
     
    xxsAm, Jul 29, 2007 IP
  12. inworx

    inworx Peon

    Messages:
    4,860
    Likes Received:
    201
    Best Answers:
    0
    Trophy Points:
    0
    #12
    No open way to bypass hotlinking from the current version.

    Also, you'd try FDCservers. They've dropped cogent as bandwidth carrier now. So, you'll have around 9 TB to use every month.
     
    inworx, Jul 30, 2007 IP
  13. xxsAm

    xxsAm Active Member

    Messages:
    464
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    60
    #13
    I was on their site earlier and still noticed cogent. I also saw PCCW on there though. Their site is very confusing to me though. When I go to the checkout it wants me to fill in the HDD/Processor/RAM yet I have no clue what their prices for them are.
     
    xxsAm, Jul 30, 2007 IP
  14. InFloW

    InFloW Peon

    Messages:
    1,488
    Likes Received:
    39
    Best Answers:
    0
    Trophy Points:
    0
    #14
    I looked at the code of the phpproxy and it's hotlinking protection would not be terribly difficult to get around.

    1. It checks for referal and guess what there is no guarantee that there will be on. To quote the PHP documentation:

    2. You could daisy chain proxy's across so all you need is one that allows hotlinking then you can push all the url's across it if you wanted.


    The best system to prevent hotlink protection is to create unique url's for each client that expire after 24 hours. When I was messing around with proxy's this is exactly what I did it is not terribly difficult to do and I doubt there is any reasonable way to get around it. Reason being is even if you daisy chain them across after 24 hours the url expires anyways thus it's not very much good.
     
    InFloW, Jul 30, 2007 IP
  15. inworx

    inworx Peon

    Messages:
    4,860
    Likes Received:
    201
    Best Answers:
    0
    Trophy Points:
    0
    #15
    You need to checkout their plans first and enter the price.

    Also, cogent will no longer be in existence on their BGP mix from August 1st.

    So,you may still see cogent till tom.:)
     
    inworx, Jul 30, 2007 IP
  16. xxsAm

    xxsAm Active Member

    Messages:
    464
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    60
    #16
    Yeah i was trying to find their plans but all I saw was a shitty opteron with 1gb of ram, and whenever I select the dedicated servers it just takes me to a checkout and excepts me to fill in all the fields. Could you possibly send me a direct link, I'm lost here :confused: .
     
    xxsAm, Jul 31, 2007 IP