79 crawlers on my site

Discussion in 'Yahoo' started by John F., Apr 3, 2008.

0
Page 1 of 2
  1. #1
    Yahoo has 79 crawlers on my site that I just created.. whats going on?

    astrospoint.com/forums
     
    John F., Apr 3, 2008 IP
  2. adda4u

    adda4u Well-Known Member

    Messages:
    1,003
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    160
    #2
    Can u tell me crawlers names

    So that i can chk out once and i will submit my site
     
    adda4u, Apr 3, 2008 IP
  3. John F.

    John F. Peon

    Messages:
    40
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    lj511882.crawl.yahoo.net -- All around the name like that. I bought the name literally five minutes ago and all the sudden Yahoo got all over me.
     
    John F., Apr 3, 2008 IP
  4. melbel

    melbel Notable Member

    Messages:
    2,373
    Likes Received:
    241
    Best Answers:
    0
    Trophy Points:
    230
    #4
    Wow, that's weird. That might be a good thing though. They might be indexing your site. I'm sure there's nothing to worry about.
     
    melbel, Apr 3, 2008 IP
    kaung likes this.
  5. adda4u

    adda4u Well-Known Member

    Messages:
    1,003
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    160
    #5
    Cooll man ...

    Thats nice to hear ....I hope u will get good pr soon
     
    adda4u, Apr 3, 2008 IP
  6. bilgi

    bilgi Well-Known Member

    Messages:
    464
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    123
    #6
    yahoo crawlers just visiting your pages
    but
    they cant send enough visitors
     
    bilgi, Apr 4, 2008 IP
  7. SticKer

    SticKer Well-Known Member

    Messages:
    2,393
    Likes Received:
    78
    Best Answers:
    0
    Trophy Points:
    115
    #7
    looks like they are upto something. Yahoo spiders are all over in masses. 105 yahoo spiders in my forum the other day.
     
    SticKer, Apr 4, 2008 IP
  8. Buhawi

    Buhawi Well-Known Member

    Messages:
    696
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    103
    #8
    How do I know if a yahoo spider or spiders crawl my site? Where do I find that sort of information?

    Kindly advise. Thanks!
     
    Buhawi, Apr 4, 2008 IP
  9. kodut

    kodut Well-Known Member

    Messages:
    2,738
    Likes Received:
    76
    Best Answers:
    1
    Trophy Points:
    170
    #9
    thats strange for a forum as big(small) as yours , did you do anything special?
     
    kodut, Apr 4, 2008 IP
  10. lpstong

    lpstong Notable Member

    Messages:
    3,292
    Likes Received:
    216
    Best Answers:
    0
    Trophy Points:
    230
    #10
    John F - Lucky you though. Yahoo musta liked your domain name and the content that was going in on your forum.

    If you have a Cpanel like Cpanel X2 or something similiar, log in doing a 2082 on your site and look for the icon that says Web/FTP stats. It gives you a variety of versions of stats like awstats, analog et cetera. I usually pick awstats for my info on what spiders crawled my site.
     
    lpstong, Apr 4, 2008 IP
  11. Buhawi

    Buhawi Well-Known Member

    Messages:
    696
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    103
    #11
    Thanks, ipstong!

    I don't think I have those. I use a WYSWYG editor (I'm a novice at this stuff, by the way) and haven't seen that kind of control in my editor interface. I wish I had them or is there any other way to find out what spiders crawl my site?
     
    Buhawi, Apr 4, 2008 IP
  12. unknowngiver

    unknowngiver Peon

    Messages:
    94
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    my site is always full of yahoo spiders
    its an old forum...and no1 uses it anymore..but still i have about 20-100 yahoo spiders at any given time
     
    unknowngiver, Apr 4, 2008 IP
  13. masterson5

    masterson5 Banned

    Messages:
    24
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #13
    You must have scores of incoming backlinks to magnetize those spiders. Is it a webmaster group?
     
    masterson5, Apr 4, 2008 IP
  14. longcall911

    longcall911 Peon

    Messages:
    1,672
    Likes Received:
    87
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Yahoo Slurp is a huge pig. It downloads 5x any other crawler to my sites, eating bandwidth like Godzilla. I now disallow Slurp from all but my first level pages.

    /*tom*/
     
    longcall911, Apr 4, 2008 IP
  15. owen1973

    owen1973 Peon

    Messages:
    7
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    that's bizarre
     
    owen1973, Apr 4, 2008 IP
  16. John F.

    John F. Peon

    Messages:
    40
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #16
    no its an Astros fan page astrospoint.com
     
    John F., Apr 4, 2008 IP
  17. jakeruston

    jakeruston Banned

    Messages:
    1,363
    Likes Received:
    89
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Its pretty usual for this to happen, Yahoo don't have as good IP management as Google.
     
    jakeruston, Apr 5, 2008 IP
  18. Spider-Man

    Spider-Man Banned

    Messages:
    2,684
    Likes Received:
    211
    Best Answers:
    0
    Trophy Points:
    0
    #18
    Check your server stats for the last month - Yahoo's been going crazy:p
     
    Spider-Man, Apr 5, 2008 IP
  19. unkush

    unkush Banned

    Messages:
    389
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #19
    same here i too had around 40+ crawler
     
    unkush, Apr 5, 2008 IP
  20. obay

    obay Notable Member

    Messages:
    2,458
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    205
    #20
    last couple of days are going crazy for me...

    Yahoo seems to be trying to improve it's results..

    I like it :)
     
    obay, Apr 5, 2008 IP
Page 1 of 2