Googlebot performing automated "searches" on my site

Discussion in 'Google' started by Blutarsky, Sep 13, 2009.

  1. #1
    Cheers everyone,

    I'm running a blog with Adsense program since april. Ten days ago I've sticked for Google Analyitcs too.

    In my blog stats there is a section where search keywords driving traffic to my site are listed; it's a few days I have noticed multiple entries where the referrer is google search, with keywords made with the blog domain name + part of the URL to a post article, for example:

    SEARCH KEYWORDS:
    =================================
    myblogname.com
    myblogname.com sun-customers-oracle-plans
    myblogname.com dells-new-inspiron-z-lapto
    myblogname.com apple’s-ipod-shuffle-now-s
    myblogname.com support-for-technical-comm
    myblogname.com logitech-harmony-700-remot
    myblogname.com apple-premieres-itunes-9
    myblogname.com visit-sun-high-performance
    myblogname.com nokia-maps-3-big-flop 1
    myblogname.com sgis-itanium-altix-4700-se
    myblogname.com intel-labs-helps-advance-f
    myblogname.com intel-ssds-inside-adaptec-
    myblogname.com lg-electronics

    I thought it could be a sort of spammer technique/mechanism and fearing also some reactions from Google, but further investigation in the web server raw logs, showed that the originating IPs are all part of the Google network.

    example
    
    74.125.75.3 - - [12/Sep/2009:14:03:48 -0500] "GET /ja/tag/sony-ericsson/ HTTP/1.1" 200 31797 "http://www.google.com/search?hl=en&q=mydomain.com+sony-ericsson" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)"
    
    Code (markup):
    Almost half of the daily blog accesses are made by google with this strange referrer technique.

    Can someone explain?
     
    Blutarsky, Sep 13, 2009 IP
  2. Blutarsky

    Blutarsky Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Could it be an anti black hat technique?

    Maybe Google is performing random "user like", "masked" accesses to verify content compliance with robot-captured content? Can't see other reasons...
     
    Blutarsky, Sep 13, 2009 IP
  3. sweta.singh.98

    sweta.singh.98 Guest

    Messages:
    628
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #3
    its amazing buddy ...
     
    sweta.singh.98, Sep 13, 2009 IP
  4. Blutarsky

    Blutarsky Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    What you mean? :)
     
    Blutarsky, Sep 14, 2009 IP
  5. brian65

    brian65 Active Member

    Messages:
    1,172
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    88
    #5
    For a few years now Google has been performing searches on sites using the forms users would access to perform a search. On my sites, I find Google seems to search for items the site is closely associated with or already does well in SERPs. For example, if my site has a link to another site called "Site X", or sometimes a link from "Site X", Google will search for Site X and index the results page.
     
    brian65, Sep 14, 2009 IP
  6. Blutarsky

    Blutarsky Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Yeah but it never happened before.... Google is using the first N characters of the URL + the domain to be sure an exact match occurs. There's no reference to googlebot in the logs...
    Could be a human checking out "black hat" contents or an automated tool that does the same....
    Today, for example there's no such thing.....
     
    Blutarsky, Sep 14, 2009 IP
  7. seminar

    seminar Active Member

    Messages:
    226
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    51
    #7
    Make a robot.Txt file with nofollow by google .Only for search
     
    seminar, Sep 14, 2009 IP
  8. Blutarsky

    Blutarsky Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    :confused: Hummm...... what about NOFOLLOWing all the links in the website?
     
    Blutarsky, Sep 14, 2009 IP