A bandwidth question????????

Discussion in 'Site & Server Administration' started by i_am_dhaval, Jan 2, 2006.

  1. #1
    A bandwidth question????????

    how google robots effects my bandwidth ?
     
    i_am_dhaval, Jan 2, 2006 IP
  2. TopSpin

    TopSpin Peon

    Messages:
    111
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #2
    It uses some...

    It really depends on how many sites you're hosting and how well 'linked' you have them (that is, making it easy for GB to find its way through your site/s).
     
    TopSpin, Jan 2, 2006 IP
  3. FFMG

    FFMG Well-Known Member

    Messages:
    1,091
    Likes Received:
    39
    Best Answers:
    0
    Trophy Points:
    160
    #3
    There is no doubt that Google, (and all other SE), does use some bandwidth but the usage is negligible.
    Furthermore what you get from Google, (and maybe other SEs), is worth it.

    But if you think they visit a lot more than they should you can edit your robot.txt file.
    Look here, http://www.google.com/webmasters/faq.html

    FFMG
     
    FFMG, Jan 2, 2006 IP
  4. Liminal

    Liminal Peon

    Messages:
    1,279
    Likes Received:
    63
    Best Answers:
    0
    Trophy Points:
    0
    #4
    i_am_dhaval: do you have to put "?" 8 times in the subject of every thread you create?
     
    Liminal, Jan 2, 2006 IP
  5. fsmedia

    fsmedia Prominent Member

    Messages:
    5,163
    Likes Received:
    262
    Best Answers:
    0
    Trophy Points:
    390
    #5
    Yes. If he doesn't, we won't see the question otherwise :rolleyes:

    To answer the question above: Yes, it uses bandwidth just the same as any other file does, but the amount it uses is VERY, VERY, VERY small.
     
    fsmedia, Jan 2, 2006 IP
  6. FFMG

    FFMG Well-Known Member

    Messages:
    1,091
    Likes Received:
    39
    Best Answers:
    0
    Trophy Points:
    160
    #6
    Not sure if that is entirely true.
    Google will use the same as any visitor, why would it be any smaller? They even request images.

    FFMG
     
    FFMG, Jan 2, 2006 IP
  7. mdvaldosta

    mdvaldosta Peon

    Messages:
    4,079
    Likes Received:
    362
    Best Answers:
    0
    Trophy Points:
    0
    #7
    As FFMG said, they use bandwidth the same as any other visitor, only difference is they go through (hopefully) all your pages to find new stuff.
     
    mdvaldosta, Jan 2, 2006 IP
  8. fsmedia

    fsmedia Prominent Member

    Messages:
    5,163
    Likes Received:
    262
    Best Answers:
    0
    Trophy Points:
    390
    #8
    As I'm rereading the thread to be clear on the subject, GoogleBot doesn't use less, but rather uses a caching technique so that each file isn't requested when it is browsed. I average about 50mb of bandwidth usage for my robots overall (including MSN, Yahoo!, GoogleBot, etc). I was thinking earlier that you were talking about robots.txt, not robots in general.

    The usage from robots is small in my opinion, compared to the XXgb being used by visitors through my sites.
     
    fsmedia, Jan 2, 2006 IP
  9. nightmare5liter

    nightmare5liter Guest

    Messages:
    79
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Watch out for jeeves/teoma. This crawler started hitting my site last month and took 4 1/2 gig ouch! Gonna have to give him some rules to follow. In comparison google visits the site daily and only took a few hundred Mb in the same period.
     
    nightmare5liter, Jan 2, 2006 IP
  10. madkad

    madkad Active Member

    Messages:
    1,686
    Likes Received:
    83
    Best Answers:
    0
    Trophy Points:
    90
    #10
    google would use the same as a visiter but google would visit more pages than a visiter cos they can the hole site well most of it :)
     
    madkad, Jan 2, 2006 IP
  11. madkad

    madkad Active Member

    Messages:
    1,686
    Likes Received:
    83
    Best Answers:
    0
    Trophy Points:
    90
    #11
    also ask jeeves isnt index new sites at the moment so i dont realy see the point in them spidering sites as well but yes they do use alot for some reason :)
     
    madkad, Jan 2, 2006 IP