thousands of pages views from Agent: Mozilla/4.0 (compatible; Google Desktop)

Discussion in 'Google' started by Tehy, Jul 3, 2007.

0
  1. #1
    What a hell is going on? I just notice that I'm getting thousands of pages views from:

    Host: 134.32.21.66
    Agent: Mozilla/4.0 (compatible; Google Desktop)

    The worst thing is that it's "crawling" totally unrelevant page(s) thousands of times.

    I block it, but I would like to know what this is...
     
    Tehy, Jul 3, 2007 IP
  2. Tehy

    Tehy Peon

    Messages:
    254
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Anyone? It's sucking my bandwidth, because it uses different IPs :(
     
    Tehy, Jul 6, 2007 IP
  3. Sphinks

    Sphinks Active Member

    Messages:
    1,102
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    78
    #3
    I think there is someone getting your content. I used to use this technique for grabing lyrics ;) !
     
    Sphinks, Jul 6, 2007 IP
  4. Tehy

    Tehy Peon

    Messages:
    254
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Ok, the thing is that it crawls totally unrelevant urls and uses my bandwidth. Any ideas how to stop this?
     
    Tehy, Jul 6, 2007 IP
  5. mikey1090

    mikey1090 Moderator Staff

    Messages:
    15,869
    Likes Received:
    1,055
    Best Answers:
    0
    Trophy Points:
    445
    Digital Goods:
    2
    #5
    and its not the google bot? you need to write a script into your site that doesnt allow robots except the SEs
     
    mikey1090, Jul 6, 2007 IP