What's a YAHOO! SLURP SPIDER?

Discussion in 'General Chat' started by thekramershow, Jul 15, 2008.

0
  1. #1
    Just wondering. I keep seeing it on my forums.
     
    thekramershow, Jul 15, 2008 IP
  2. SticKer

    SticKer Well-Known Member

    Messages:
    2,393
    Likes Received:
    78
    Best Answers:
    0
    Trophy Points:
    115
    #2
    They are Yahoo's search spiders. They crawl websites looking for new content.
     
    SticKer, Jul 15, 2008 IP
  3. thekramershow

    thekramershow Banned

    Messages:
    655
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #3
    They 'crawl' all day long.
     
    thekramershow, Jul 15, 2008 IP
  4. chandan123

    chandan123 Prominent Member

    Messages:
    11,586
    Likes Received:
    578
    Best Answers:
    0
    Trophy Points:
    360
    #4
    yahoo bots :cool:

    they are searching your site to find out about sites contents ;)

    :confused: is it forum ? normally phpbb gets this type of crawling :p
     
    chandan123, Jul 15, 2008 IP
  5. thekramershow

    thekramershow Banned

    Messages:
    655
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Its a vBulletin forum. (Like this.)
     
    thekramershow, Jul 15, 2008 IP
  6. chandan123

    chandan123 Prominent Member

    Messages:
    11,586
    Likes Received:
    578
    Best Answers:
    0
    Trophy Points:
    360
    #6
    u can stop that using robots.txt if you want ;)
     
    chandan123, Jul 15, 2008 IP
  7. crownrahul

    crownrahul Well-Known Member

    Messages:
    2,279
    Likes Received:
    248
    Best Answers:
    0
    Trophy Points:
    133
    #7
    Search Engine Spiders, they search new contents and listing them on net (promote)
    thanks
     
    crownrahul, Jul 15, 2008 IP