robots.txt and delet the pages

Discussion in 'robots.txt' started by surekhaweb, Oct 2, 2007.

  1. #1
    surekhaweb, Oct 2, 2007 IP
  2. Nucca_The_Warrior

    Nucca_The_Warrior Peon

    Messages:
    6
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Nothing, or just type in....

    User-agent: Bot name
    Disallow: /directory/page1.html
    
    User-agent: bot name
    Disallow: /directory/page2.html
    Code (markup):
    Thats how i do mine, but im thinkin it could be kinda redundent...[​IMG]
     
    Nucca_The_Warrior, Oct 22, 2007 IP