1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Become Friends With MSNBot

Discussion in 'Bing' started by raven2424, Jan 17, 2006.

  1. #1
    Recently i was looking at one of my sites and noticed this

    MSNBot last vist 12 Jan 2006 - 21:50

    I am wondering how can i get msn bot to come back almost daily?? I have many backlinks and even some from PR6 high traffic sites the bot should be there dailiy to update my sites serps??
    SEMrush
     
    raven2424, Jan 17, 2006 IP
    SEMrush
  2. maldives

    maldives Prominent Member

    Messages:
    7,188
    Likes Received:
    901
    Best Answers:
    0
    Trophy Points:
    310
    #2
    I recommend to use robot.txt on your root direcltory. Make sure MSNbot is allowed :D
     
    maldives, Jan 17, 2006 IP
  3. raven2424

    raven2424 Well-Known Member

    Messages:
    754
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    160
    #3
    what is a good example of a robot.txt and what it should basicly state to let it crawl everything besides cgi ?

    EDIT: checked my site and it has both robot.txt & robots.txt dunno if the s on it matters but on msn they referr to it as robots.txt
     
    raven2424, Jan 17, 2006 IP
  4. maldives

    maldives Prominent Member

    Messages:
    7,188
    Likes Received:
    901
    Best Answers:
    0
    Trophy Points:
    310
    #4
    1. Allowing all the robots:
    User-agent: *
    Disallow:

    2. Allow only MSNbot:
    User-agent: msnbot
    Disallow:User-agent: *
    Disallow: /
     
    maldives, Jan 17, 2006 IP
  5. raven2424

    raven2424 Well-Known Member

    Messages:
    754
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    160
    #5
    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /images/

    that is how my robots.txt is looking now so it looks to be fine, any other ways to get msn to visit more often.
     
    raven2424, Jan 17, 2006 IP
  6. INV

    INV Peon

    Messages:
    1,686
    Likes Received:
    101
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Get more links, thats all you get really do. Trying to tweak your robot file and metatags other then making sure the bots arent blocked is pointless.
     
    INV, Jan 17, 2006 IP
  7. raven2424

    raven2424 Well-Known Member

    Messages:
    754
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    160
    #7
    my site has 2,509 and some are from site that would get crawled dailiy just weird usually i see msnbot every day or every 2nd day on my other sites weird.
     
    raven2424, Jan 17, 2006 IP
    maldives likes this.
  8. stereotaxis

    stereotaxis Peon

    Messages:
    58
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I have MSN bot constantly on my site. several times a day.
    It's much faster than Google bot
     
    stereotaxis, Jan 17, 2006 IP
  9. dave487

    dave487 Peon

    Messages:
    701
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    0
    #9
    If you keep adding fresh content to your site then search engines will spider it more often.
     
    dave487, Jan 17, 2006 IP
  10. stereotaxis

    stereotaxis Peon

    Messages:
    58
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    I add content every week at minimum.
    As frequently you add, they index more.

    It is even woth to program some dynamic contant that changes every day or week.
     
    stereotaxis, Jan 17, 2006 IP
  11. raven2424

    raven2424 Well-Known Member

    Messages:
    754
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    160
    #11
    i added a blog to my site and if i update that should that cause the bots to crawl my domain.com and update there listings?

    blog is linked to from main page and from blog to main page so the bots should find it all.
     
    raven2424, Jan 17, 2006 IP