Google is doing something odd on my site...

Discussion in 'Google' started by gbh1935, Aug 12, 2008.

  1. #1
    I noticed my server was running a little hot so I started poking around in the logs. My site is currently getting flooded with traffic from GoogleBot. Googlebot is using my sites built in search and is plugging in words. Going back, it looks like it has been doing this for days and it is gaining speed.

    Has anyone else seen this before?
     
    gbh1935, Aug 12, 2008 IP
  2. mcaronan

    mcaronan Peon

    Messages:
    441
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Hmm... that's odd.. :confused: Never experienced it before..
     
    mcaronan, Aug 12, 2008 IP
  3. informationHell

    informationHell Peon

    Messages:
    931
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #3
    never happend to me before :|
     
    informationHell, Aug 13, 2008 IP
  4. wpinstall

    wpinstall Peon

    Messages:
    102
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    You mean it uses your search form to make searches? what kind of words/keywords is the google bot using?
     
    wpinstall, Aug 13, 2008 IP
  5. Jasmine998

    Jasmine998 Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    You mean Googlebot searches for a word on your site and then indexes that page? If so, it happened to one of our site too (from google and yahoo). Don't know what to make of it though.
     
    Jasmine998, Aug 13, 2008 IP
  6. Divisive Cottonwood

    Divisive Cottonwood Peon

    Messages:
    1,674
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Wouldn't it be an idea to use the robots.txt to stop access to you search page?

    Also, placing this at the top of you robots.txt will slow down the rate that Googlebot hits your website:
    
    User-agent: *
    Crawl-delay: 5
    
    Code (markup):
     
    Divisive Cottonwood, Aug 13, 2008 IP
  7. crumblepie

    crumblepie Well-Known Member

    Messages:
    2,612
    Likes Received:
    42
    Best Answers:
    0
    Trophy Points:
    160
    #7
    That's really weird... it must be eating up a lot of bandwidth too
     
    crumblepie, Aug 13, 2008 IP
  8. Xemion

    Xemion Peon

    Messages:
    54
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Xemion, Aug 13, 2008 IP
  9. Jasmine998

    Jasmine998 Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    I guess Google thinks our sites are high quality :p
     
    Jasmine998, Aug 13, 2008 IP
  10. invisible

    invisible Banned

    Messages:
    2,031
    Likes Received:
    95
    Best Answers:
    0
    Trophy Points:
    0
    #10
    I have never experienced or seen people talking I agree with Divisive Cottonwood put it in your robots.txt and it will slow down
     
    invisible, Aug 13, 2008 IP
  11. digitalstyle_surat

    digitalstyle_surat Active Member

    Messages:
    182
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    58
    #11
    I have my website www.styledesign.in ..

    The day before yesterday google pagerank was 3
    Yesterday pagerank was 4

    and now today my pagerank is just 2


    I dont understand how my pagerank changed..:mad: why google did this??
     
    digitalstyle_surat, Aug 13, 2008 IP
  12. SiLvER

    SiLvER Well-Known Member

    Messages:
    610
    Likes Received:
    22
    Best Answers:
    0
    Trophy Points:
    130
    #12
    wow :S really weird stuff
     
    SiLvER, Aug 13, 2008 IP
  13. magda

    magda Notable Member

    Messages:
    5,197
    Likes Received:
    315
    Best Answers:
    0
    Trophy Points:
    280
    #13
    I doubt they did.
    the PR that's publicly available is both crude and almost always out of date.
    The fluctuations you see are probably due to whatever method you're using to check it using different data centres.
     
    magda, Aug 13, 2008 IP
  14. Preseren

    Preseren Active Member

    Messages:
    275
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    80
    #14
    well google has the results from a search on my page in the rankings, that means it had to do the searches sometimes....
    Some results are also in the site links at the google results page...
     
    Preseren, Aug 13, 2008 IP
  15. angilina

    angilina Notable Member

    Messages:
    7,824
    Likes Received:
    186
    Best Answers:
    0
    Trophy Points:
    260
    #15
    If it is ok to block googlebot from crawling your site's search function, then why not you block it via robots file?

    I have blocked googlebot from accessing my forum search function.
     
    angilina, Aug 13, 2008 IP
  16. gbh1935

    gbh1935 Peon

    Messages:
    585
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #16
    Mostly resources, I had to do some quick tuning to the mysql database so that the load would go down. What is funny, once I did that, the speed of inquires increased.. :)
     
    gbh1935, Aug 13, 2008 IP
  17. jakycharles

    jakycharles Banned

    Messages:
    37
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #17
    i dont think that goolge need any bot for their systems
    if this will happen so google bot wil give them automatic ranking without any traffic
     
    jakycharles, Aug 13, 2008 IP
  18. responsivewebsolutions

    responsivewebsolutions Guest

    Messages:
    94
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #18
    That's strange, you would think the pr would go up instead of down right?
     
    responsivewebsolutions, Aug 13, 2008 IP
  19. Gallito

    Gallito Peon

    Messages:
    1,939
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    0
    #19
    Very interesting, does that mean Google is actually using the search function to find pages to index then?
     
    Gallito, Aug 13, 2008 IP
  20. gbh1935

    gbh1935 Peon

    Messages:
    585
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #20
    I hope so... I track the number of pages listed in a spreadsheet, I will have to compare over the next few days.
     
    gbh1935, Aug 13, 2008 IP