Bot Crawling >?

Discussion in 'Traffic Analysis' started by davcheong, Nov 9, 2005.

0
  1. #1
    hmm.. come to this point, i just notice the Msnbot is crawling my website more then googlebot do. How come? Anyone have any tips or hints that can share?
     
    davcheong, Nov 9, 2005 IP
  2. Jocelyn

    Jocelyn Guest

    Messages:
    140
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Usually when google is doing an update crawling goes down until it' done, but I must say that msnbot is getting pretty more active also.
     
    Jocelyn, Nov 9, 2005 IP
  3. Web Gazelle

    Web Gazelle Well-Known Member

    Messages:
    3,590
    Likes Received:
    259
    Best Answers:
    0
    Trophy Points:
    155
    #3
    I have seen the same thing. Seems MSN bot is alot more active than Googlebot or even Slurp. Maybe that is why MSN is so quick to update. :D
     
    Web Gazelle, Nov 9, 2005 IP
  4. davcheong

    davcheong Well-Known Member

    Messages:
    1,148
    Likes Received:
    51
    Best Answers:
    0
    Trophy Points:
    175
    #4
    Inktomi Slurp is not bad also. But Alexa Bot is also keeping up too. but i still think MSNbot is getting better and better each day.
     
    davcheong, Nov 9, 2005 IP
  5. macdesign

    macdesign Peon

    Messages:
    568
    Likes Received:
    59
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I've got a couple of sites being botted to death by Inktomi, and they show up in no search engine depite that.

    Multiple MSN crawls are usually followed by visibility in MSN
     
    macdesign, Nov 9, 2005 IP