1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

MSNBot Lives!

Discussion in 'Bing' started by hexed, May 7, 2004.

0
  1. #1
    Looks like it may be time soon to change the description of this forum from "THE search engine." to "THE defending champ (for now)"

    MSNBot has been reported to have been deep crawling some large sites more actively than Googlebot the past couple days.

    Looks like MSN maybe will "flip a switch" soon.

    Hexed
     
    hexed, May 7, 2004 IP
  2. GuyFromChicago

    GuyFromChicago Permanent Peon

    Messages:
    6,728
    Likes Received:
    528
    Best Answers:
    0
    Trophy Points:
    0
    #2
    The MSN bot is slightly ahead of the Google bot on just about all of my sites over the last 3 days. A very significant increase in activity.
     
    GuyFromChicago, May 7, 2004 IP
  3. Old Welsh Guy

    Old Welsh Guy Notable Member

    Messages:
    2,699
    Likes Received:
    291
    Best Answers:
    0
    Trophy Points:
    205
    #3
    July was the date to flip the switch wasn't it? maybe I am wrong though, hard week, well tired and all that lol
     
    Old Welsh Guy, May 8, 2004 IP
  4. hexed

    hexed Peon

    Messages:
    333
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I couldn't comment on the date that MSN has specifed to "flip the switch" July seems a bit far away.

    I could almost bet we'll see it sooner. Microsoft likes surprises.

    Hexed
     
    hexed, May 8, 2004 IP
  5. Zodiac51

    Zodiac51 Peon

    Messages:
    10
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Yep, msnbot been crawlin me, have you checked out http://search.msn.com/webmasters/guidelines.aspx

    "Items and techniques discouraged by MSN Search
    MSNBot recognizes the following items and techniques as spam, an inappropriate use of the index. Use of these items and techniques may affect how your site is ranked within MSN Search, and may result in the removal of your page or site from the MSN Search index.

    • Loading pages with irrelevant words in an attempt to increase a page's keyword density. This includes stuffing ALT tags that users are unlikely to view.
    • Using hidden text or links. You should use only text and links that are visible to users.
    • Using techniques to artificially increase the number of links to your page, such as link farms. "
    Stuffing ALT tags... Oh Bugger ! :D
     
    Zodiac51, Jun 9, 2004 IP
  6. THT

    THT Peon

    Messages:
    686
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #6
    yeah i noticed this a lot too

    can anyone explain why?
    I seemed to have missed something :D
     
    THT, Jun 9, 2004 IP
  7. vinyl

    vinyl Well-Known Member

    Messages:
    302
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    165
    #7
    what is $HTTP_USER_AGENT for MSN's bot? is it 'MSNBot' or something else?
     
    vinyl, Jun 9, 2004 IP
  8. nlopes

    nlopes Guest

    Messages:
    103
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    user agent is: "msnbot/0.11 (+http://search.msn.com/msnbot.htm)"

    This month I had 765 hits from msnbot and just 5 from google. Msn bot is crawling my new pages pretty fast!!! (google is much slower...)
     
    nlopes, Jun 9, 2004 IP
  9. Zodiac51

    Zodiac51 Peon

    Messages:
    10
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #9
    GET /robots.txt - 80 - 65.54.164.94 HTTP/1.0 msnbot/0.11+(+http://search.msn.com/msnbot.htm) - - www.gurat.co.uk :)
     
    Zodiac51, Jun 9, 2004 IP
  10. Zodiac51

    Zodiac51 Peon

    Messages:
    10
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #10
    ohh nearly hit reply at exactly the same time :eek:
     
    Zodiac51, Jun 9, 2004 IP
  11. nlopes

    nlopes Guest

    Messages:
    103
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #11
    one minute of difference :)
     
    nlopes, Jun 9, 2004 IP
  12. vinyl

    vinyl Well-Known Member

    Messages:
    302
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    165
    #12
    thanks. is there a way to identify all of them dynamicly, without knowing their user agents?
     
    vinyl, Jun 9, 2004 IP
  13. nlopes

    nlopes Guest

    Messages:
    103
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #13
    you must know the user agents...

    Wiyhout knowing them, how would you identify them? Maybe you could look for "bot" or "crawler" since most SEs uses them.
     
    nlopes, Jun 10, 2004 IP