Bandwidth Limited About to Excess

Discussion in 'WordPress' started by bigmodo, Aug 17, 2009.

  1. #1
    My wordpress blog at modospot.com/review is about to exceed 20g of its bandwidth. I do not know this is so because i do not get much traffic to my blog. Does anyone know what is causing this and how i can stop it? I feel this is the work of bots. Please help me.
     
    bigmodo, Aug 17, 2009 IP
  2. coba

    coba Peon

    Messages:
    109
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    To block all bots to your site create robots.txt and paste this text inside :-
    upload robots.txt to root directory of your host

    Hope this will help.
     
    coba, Aug 17, 2009 IP
  3. bigmodo

    bigmodo Well-Known Member

    Messages:
    520
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    108
    #3

    will this block helpful bots like search engine bots?
     
    bigmodo, Aug 17, 2009 IP
  4. DesignWeb

    DesignWeb Active Member

    Messages:
    251
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    58
    #4
    Hey @coba do you really think stopping search engines (including Google) to index your site is good idea?

    @bigmodo there are too many contents per page in your site. Your homepage saved is almost 3 MB :eek:
    Just quick maths, currently for 1000 pageviews you spend = 3GB traffic.
    Note, not unique visitors but pageviews. 1 user may reload more than once some of your pages. So, my suggestion is to optimize the content per page
     
    DesignWeb, Aug 17, 2009 IP
  5. coba

    coba Peon

    Messages:
    109
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    To block from search engine is not a good way, but some time I need to block my website because of over used of bandwidth. My host with 50 GB bandwidth and 25,000 articles. Last week I deleted old posts from SQL to reduced bandwidth limit and now with 15,000 articles.
     
    coba, Aug 18, 2009 IP
  6. Bohra

    Bohra Prominent Member

    Messages:
    12,573
    Likes Received:
    537
    Best Answers:
    0
    Trophy Points:
    310
    #6
    It looks like u get many bot visits see ur logs and confirm
     
    Bohra, Aug 18, 2009 IP
  7. abeng

    abeng Active Member

    Messages:
    285
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    60
    #7
    Yes, you can block un needed bots like bot spammer and email crawler with robots.txt
     
    abeng, Aug 18, 2009 IP
  8. theapparatus

    theapparatus Peon

    Messages:
    2,925
    Likes Received:
    119
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Get with your host. You should have a stats program of some sort included with your hosting package. Find out where the traffic is coming from. It may be coming from all one source or a few sources. It may also be email spammers relaying their spam emails through your server.

    This really is a question for your host though as they're the only ones who can have access to the stats and logs.

    Blocking via robots.txt is a bad idea as 1) "evil" bots aren't going to even look at the file and 2) it'll block out the good bots who do pay attention to the robots rules.
     
    theapparatus, Aug 18, 2009 IP
  9. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #9
    Go through your web logs and see what it is that is being downloaded and who's doing it. I ended up throttling MSNBot at this site because they were spidering at a rate that was using 2TB (yes, terabytes) per month.
     
    digitalpoint, Aug 18, 2009 IP
    mdvasanth86 likes this.
  10. sylv3rblade

    sylv3rblade Peon

    Messages:
    292
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #10
    you probably got your images hotlinked
     
    sylv3rblade, Aug 19, 2009 IP
  11. theapparatus

    theapparatus Peon

    Messages:
    2,925
    Likes Received:
    119
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Yup, had that happen to a client which is why you should be checking your webserver logs to see what's occurring. There should be an option in there to see the most popular urls and files being called. Also the most popular sources of traffic which is what Shawn and I were suggesting to check.
     
    theapparatus, Aug 19, 2009 IP
  12. webprone

    webprone Well-Known Member

    Messages:
    163
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    133
    #12
    webprone, Aug 19, 2009 IP
  13. theapparatus

    theapparatus Peon

    Messages:
    2,925
    Likes Received:
    119
    Best Answers:
    0
    Trophy Points:
    0
    #13
    May want to double check the thread you;re posting in as the issue appears to be bandwidth related, not processor related.
     
    theapparatus, Aug 19, 2009 IP
  14. webprone

    webprone Well-Known Member

    Messages:
    163
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    133
    #14
    Your are absolutely right!
    Wp-Super-cache and other ways to optimize the site do what ?
    It of-course decreases the bandwidth consumption by almost 50% of what it is use currently !

    Anyway, if i'm not correct then forgive me, i'm a moron ! :p
    ~Peace
     
    webprone, Aug 20, 2009 IP
  15. theapparatus

    theapparatus Peon

    Messages:
    2,925
    Likes Received:
    119
    Best Answers:
    0
    Trophy Points:
    0
    #15
    What you're probably looking at is the gzip option within the wp-super-cache plugin. That actually was an option in older versions of wordpress but was removed as too many servers didn;t support it. Donncha himself makes mention in the docs that it should only be turned on if you;re absolutely sure your server supports it. His plugin does ship with it turned off as a default.

    If you want to turn on gzip, you can actually do that in apache itself and save yourself the usage of a plugin. We still have 90 wordpress blogs on our servers along with 120 WPMu installs and we run wp-super-cache in half mode, just to save processor usage and cache the option data so it doesn;t have to be polled every time.
     
    theapparatus, Aug 20, 2009 IP