Three Googlebots at the same time crawling

Discussion in 'Google' started by MrWm, Dec 22, 2008.

0
  1. #1
    Hi,

    I have a website and three Googlebots crawl it at the same time. It caused a lot of traffic and pageviews. How can I reduce this to one?

    crawl-66-249-71-34.googlebot.com
    crawl-66-249-71-33.googlebot.com
    crawl-66-249-71-35.googlebot.com

    Thanks in advance

    :)
     
    MrWm, Dec 22, 2008 IP
  2. katty.will

    katty.will Well-Known Member

    Messages:
    250
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    105
    #2
    May be you can slow down your crawling through Google Webmaster Tools!
     
    katty.will, Dec 22, 2008 IP
  3. GokuDBZ

    GokuDBZ Well-Known Member

    Messages:
    408
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    140
    Digital Goods:
    2
    #3
    lol
    Dont you want Traffic on your site ???
    Just edit you robots.txt file :p
     
    GokuDBZ, Dec 22, 2008 IP
  4. MrWm

    MrWm Peon

    Messages:
    4
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Already done a week ago, but still three bots :mad:

    I want traffic, but not three bots at the same time.
     
    MrWm, Dec 22, 2008 IP
  5. crivion

    crivion Notable Member

    Messages:
    1,669
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    210
    Digital Goods:
    3
    #5
    That is only a good thing, people are looking for googlebot everywhere and u wanna only one. This only can give u benefits for higher rankins in different geolocations.
     
    crivion, Dec 22, 2008 IP
  6. goscript

    goscript Prominent Member

    Messages:
    2,753
    Likes Received:
    306
    Best Answers:
    0
    Trophy Points:
    315
    #6
    Why not? :confused: what's the problem with google indexing your site?
    The more bots, more indexed pages in google results, meaning more traffic.

    People are getting weird:eek:
     
    goscript, Dec 22, 2008 IP
  7. wolfey

    wolfey Peon

    Messages:
    168
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    I love google bots. Please google give me to many bots.
     
    wolfey, Dec 22, 2008 IP
  8. MrWm

    MrWm Peon

    Messages:
    4
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Because the Googlebots make my site overloaded and sometimes slow.
     
    MrWm, Dec 22, 2008 IP
  9. fsmobilez

    fsmobilez Active Member

    Messages:
    449
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    78
    #9
    U should have to upgrade ur server or there is an option in webmaster tools in which u can set request per second and crawl rate etc

    But if google bot is crawling ur server u should be happy bcoz they may find something in ur site and wana send u traffic
     
    fsmobilez, Dec 22, 2008 IP
  10. rena

    rena Peon

    Messages:
    1,987
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Why want to be one is there any benefit from crawl by one bot. I dont think so and no need to worry much on it. This process from google and can not control any body even by robots.txt
     
    rena, Dec 22, 2008 IP
  11. acecubbie

    acecubbie Peon

    Messages:
    78
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Are three bots really enough to slow a site down? I regularly have several bots crawling at the same time and I haven't noticed a problem.
     
    acecubbie, Dec 22, 2008 IP
  12. goscript

    goscript Prominent Member

    Messages:
    2,753
    Likes Received:
    306
    Best Answers:
    0
    Trophy Points:
    315
    #12
    No, it's just like having 3 normal visitors on your site.
     
    goscript, Dec 22, 2008 IP