Is this correct?

Discussion in 'robots.txt' started by Guitarkalle, Jan 18, 2009.

0
  1. #1
    So I want search engines not to index my search-page and my articlepage with only text.

    This is my robots.txt:

    User-Agent: *
    Disallow: /articleonlytext.aspx
    Allow: /
    Disallow: /search.aspx


    correct or not?
     
    Guitarkalle, Jan 18, 2009 IP
  2. shailendra

    shailendra Peon

    Messages:
    1,225
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    0
    #2
    yes it is absolutely correct
     
    shailendra, Jan 18, 2009 IP
    Guitarkalle likes this.
  3. pageloadtime

    pageloadtime Peon

    Messages:
    9
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I agree that is correct
     
    pageloadtime, Jan 19, 2009 IP
  4. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #4
    You could write it as written below:

    User-Agent: *
    Disallow: /articleonlytext.aspx
    Disallow: /search.aspx

    All the other pages will automatically allowed.
     
    manish.chauhan, Jan 20, 2009 IP