Robots.txt problem

Discussion in 'All Other Search Engines' started by monicalou123, Oct 23, 2007.

0
  1. #1
    I found that my sites haven't crawl by msn bot. Please let me know how to i edit my robots.txt to let msnbot crawl my sites. Thanks
     
    monicalou123, Oct 23, 2007 IP
  2. tarponkeith

    tarponkeith Well-Known Member

    Messages:
    4,758
    Likes Received:
    279
    Best Answers:
    0
    Trophy Points:
    180
    #2
    User-agent: *
    Disallow:
     
    tarponkeith, Oct 23, 2007 IP
  3. monicalou123

    monicalou123 Peon

    Messages:
    902
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Thank you very much
     
    monicalou123, Oct 23, 2007 IP
  4. nickstan

    nickstan Peon

    Messages:
    781
    Likes Received:
    31
    Best Answers:
    0
    Trophy Points:
    0
    #4
    if you have a sitemap, you may want to include this is your robots:

    Sitemap: <sitemap_location>
     
    nickstan, Oct 23, 2007 IP
  5. Boardwalk

    Boardwalk Well-Known Member

    Messages:
    1,651
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    140
    #5
    Boardwalk, Oct 23, 2007 IP