Google using alot of bandwidth?

Discussion in 'Google' started by melol2, Oct 10, 2006.

  1. #1
    I checked my logs today. I was suprised to see this at the top of the log.

    media.sandsword.com
    %bytes host
    1.04% (My IP)
    45.08% 66.249.66.239

    So I googled the IP. And it says it was from googlebot. Now this site is the site I store all the media from my site on. And I do not want google finding it because it wastes my bandwidth. Is there a good way to stop google from going to all the links from my site to this one? It really wastes bandwidth.
     
    melol2, Oct 10, 2006 IP
  2. HAWK

    HAWK Peon

    Messages:
    197
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Read up about robots.txt which is a file specifically used to block spiders from visiting parts of your site.
     
    HAWK, Oct 10, 2006 IP
  3. websiteideas

    websiteideas Well-Known Member

    Messages:
    1,406
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    130
    #3
    You just put a line in your robots.txt file that might look something like this:
    Disallow: /dir
     
    websiteideas, Oct 13, 2006 IP
  4. PunjabiSingh

    PunjabiSingh Peon

    Messages:
    20
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    unless you specifically hate it, i would happily sacrifice my bandwidth for a month to google... in the end, it'll only increase the good traffic.

    you should check using some sort of traffic analyzer if google is reading php files or what, just to make sure there's nothing wrong. the only thing i hate google is when the bot starts scanning pdfs/ps files, that hits the server the hardest (atleast i think, maybe somebody could clarify).
     
    PunjabiSingh, Oct 13, 2006 IP
  5. Sohan

    Sohan Peon

    Messages:
    2,330
    Likes Received:
    74
    Best Answers:
    0
    Trophy Points:
    0
    #5
    To google, bandwidth is money lol. The more they spend, spider, index the more they earn.
     
    Sohan, Oct 14, 2006 IP