Google going through my proxy.. Bandwidth problem

Discussion in 'Site & Server Administration' started by -bank-, Sep 24, 2007.

0
  1. #1
    Hi,

    I was just wondering if any one is experiancing the same problem of google spidering through their proxy? Also how can I stop it, I've tried placing a robots.txt file in, although it kept going (set it on index.php?tt_url=). Its just its eating tonnes of bandwidth, I have a PR4 so don't wish to block google completely. Also as its fetching other peoples content they'll end up being penalised, would like some help :)

    Thanks
     
    -bank-, Sep 24, 2007 IP
  2. Konexion

    Konexion Peon

    Messages:
    11
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Disallow: /*?

    Should fix your problem.
     
    Konexion, Sep 24, 2007 IP
  3. Phooey

    Phooey Active Member

    Messages:
    413
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    80
    #3
    I had the same issue, but the robots.txt files seems to have fixed it. What are the exact contents of your file, just in case?
     
    Phooey, Sep 24, 2007 IP