Yahoo bot with strange useragent?

Discussion in 'Yahoo' started by guidyy, Apr 12, 2008.

0
  1. #1
    I got report this morning from my security script:

    Date & Time: 2008-04-12 07:18:50 CEST GMT +0200
    Blocked IP: 74.6.13.121
    User ID: Anonymous (1)
    Reason: Abuse-Harvest
    String Match: Wget/1.10.2
    --------------------
    User Agent: Wget/1.10.2 (Red Hat modified) <--------
    Query String: www. mysite.net/index.php
    Get String: www. mysite.net/index.php
    Post String: www. mysite.net/index.php
    Forwarded For: none
    Client IP: none
    Remote Address: 74.6.13.121
    Remote Port: 45192
    Request Method: GET

    Ip belongs to Inktomi Corporation

    Anyone saw something similar?
     
    guidyy, Apr 12, 2008 IP
  2. guidyy

    guidyy Active Member

    Messages:
    574
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    58
    #2
    My script also blocked this one:
    Date &amp; Time: 2008-04-12 12:31:01 CEST GMT +0200
    Blocked IP: 68.180.153.77
    User ID: Anonymous (1)
    Reason: Abuse-Harvest
    String Match: Wget/1.10.2
    --------------------

    Forwarded For: 68.180.153.77 <------
    Client IP: none
    Remote Address: 74.6.13.125 <------
    Remote Port: 45104
    Request Method: GET

    What's going on @yahoo?
     
    guidyy, Apr 12, 2008 IP
  3. godsofchaos

    godsofchaos Peon

    Messages:
    2,595
    Likes Received:
    124
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Been seeing things like this lately, it can be that they are experimenting on new ways to crawl your site...
     
    godsofchaos, Apr 12, 2008 IP
  4. guidyy

    guidyy Active Member

    Messages:
    574
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    58
    #4
    This thing is annoying.
    The bots with that useragent don't follow robots.txt either. (has been reported on their blog also by other people)
    I blocked the bots at IP level, and now I lost ranking on Y!.
    I'm kinda upset.....
     
    guidyy, Apr 17, 2008 IP
  5. 007c

    007c Peon

    Messages:
    611
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Maybe there checking up on cloaking some users use some type of if useragent is yahoobot show this if user agent not yahoo show something else in php anyways maybe in htaccess too....
     
    007c, Apr 17, 2008 IP
  6. godsofchaos

    godsofchaos Peon

    Messages:
    2,595
    Likes Received:
    124
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Damn I havent taken any measure against it though.... I just hope they dont increase the load of the server too much thats all... can bots do that?
     
    godsofchaos, Apr 17, 2008 IP