over 500 spiders from Yahoo on a daily basis

Discussion in 'Yahoo' started by Devilfish, Mar 28, 2008.

  1. rJBee

    rJBee Guest

    Messages:
    146
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #21
    Only 500? I got over 1,300 at my forum today..

    [​IMG]
    [​IMG]
     
    rJBee, Mar 29, 2008 IP
  2. godsofchaos

    godsofchaos Peon

    Messages:
    2,595
    Likes Received:
    124
    Best Answers:
    0
    Trophy Points:
    0
    #22
    God almighty. How's that possible? Lol.
     
    godsofchaos, Mar 29, 2008 IP
  3. kingofsanda

    kingofsanda Peon

    Messages:
    8,154
    Likes Received:
    218
    Best Answers:
    0
    Trophy Points:
    0
    #23
    Yahoo spiders are out of control.
     
    kingofsanda, Mar 29, 2008 IP
  4. hockeyhero

    hockeyhero Well-Known Member

    Messages:
    853
    Likes Received:
    25
    Best Answers:
    0
    Trophy Points:
    120
    #24
    weird.... yahoo hasn't been on my forum that much...:confused:
     
    hockeyhero, Mar 29, 2008 IP
  5. 55hostgm

    55hostgm Peon

    Messages:
    23
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #25
    why would yahoo send so many bots to ur site lol
     
    55hostgm, Mar 29, 2008 IP
  6. djixas

    djixas Well-Known Member

    Messages:
    749
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    110
    #26
    If you're talking about hits, then I get more than 10 000 hits from Yahoo daily and spiders eats around 10 GB of traffic per month.

    What I said earlier was spiders from different IPs at the same time, creating hundreds of never stopping connections.
     
    djixas, Mar 29, 2008 IP
  7. ArLinD

    ArLinD Active Member

    Messages:
    1,186
    Likes Received:
    34
    Best Answers:
    0
    Trophy Points:
    90
    #27
    Bots have been weird for me too. Maybe Yahoo changed smth to increase their performance!
     
    ArLinD, Mar 29, 2008 IP
  8. 55hostgm

    55hostgm Peon

    Messages:
    23
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #28
    call yahoo support tell them to back off i think you can sue becuase that is kinda close to a botnet attack,
     
    55hostgm, Mar 29, 2008 IP
  9. Muhammad Mustafa

    Muhammad Mustafa Active Member

    Messages:
    114
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    55
    #29
    I think Yahoo is changing something up at their end, I got almost the same with an Arabic Forum!
     
    Muhammad Mustafa, Mar 29, 2008 IP
  10. soccerfriend

    soccerfriend Well-Known Member

    Messages:
    1,060
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    128
    #30
    I have this on all of my sites.. Makes me start using Yahoo search again
     
    soccerfriend, Mar 29, 2008 IP
  11. domainer_10

    domainer_10 Peon

    Messages:
    1,720
    Likes Received:
    24
    Best Answers:
    0
    Trophy Points:
    0
    #31
    I run 3 different forums and noticed the last week a huge surge in yahoo bot traffic. I think in the past its done that before and then eventually dropped off. This is the largest Ive seen it though ever.
     
    domainer_10, Mar 29, 2008 IP
  12. BlohG

    BlohG Banned

    Messages:
    675
    Likes Received:
    36
    Best Answers:
    0
    Trophy Points:
    0
    #32
    even i sensed the same.
    i have been getting around 100 yahoo spiders at a time daily, dunno what the heck is yahoo upto?
     
    BlohG, Mar 29, 2008 IP
  13. HomeRun

    HomeRun Peon

    Messages:
    181
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #33
    Yep Yahoo bots are all over my site just today I got

    2304 yahoo bots
    333 google bots
    2 msn bots
     
    HomeRun, Mar 30, 2008 IP
  14. snappingpig

    snappingpig Banned

    Messages:
    331
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #34
    yahoo has been doing this for many months actually, it's stupid because there are plenty of spiders and all, but I never get any actual visitors from yahoo. Why send that many spiders if my site is never going to be seen on yahoo, I get tons of traffic from Google and I hope that never changes.
     
    snappingpig, Mar 30, 2008 IP
  15. blue_angel

    blue_angel Well-Known Member

    Messages:
    1,174
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    130
    #35
    Yeah me too i noticed lots of yahoo bots and Google .....
     
    blue_angel, Mar 30, 2008 IP
  16. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #36
    This is nothing new. Yahoo has always sent out Slurp in gangs.

    You are supposed to be able to limit Slurp activity by adding this to robots.txt:

    User-Agent: Slurp 
    Crawl-Delay: 10
    Code (markup):
    but frankly I've never been convinced it really does much of anything to slow them down.
     
    minstrel, Mar 31, 2008 IP
  17. high_flying

    high_flying Banned

    Messages:
    25
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #37
    It's nice having em critters. Makes newbies think your forum's busy.
     
    high_flying, Mar 31, 2008 IP
  18. Michael Richard

    Michael Richard Banned

    Messages:
    31
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #38
    this is considered spam report it,, u dont want ur site to get flooded by yahoo bots ,, contact yahoo right away
     
    Michael Richard, Apr 3, 2008 IP
  19. Michael Richard

    Michael Richard Banned

    Messages:
    31
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #39
    u can stop them by editing robots.txt
     
    Michael Richard, Apr 3, 2008 IP
  20. dspohn23

    dspohn23 Peon

    Messages:
    370
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #40
    Yahoo is going absolutely crazy. They are trying to improve their search results and income, so they can protect themselves from Micro$oft
     
    dspohn23, Apr 3, 2008 IP