1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Is this correct?

Discussion in 'robots.txt' started by Guitarkalle, Jan 18, 2009.

0
  1. #1
    So I want search engines not to index my search-page and my articlepage with only text.

    This is my robots.txt:

    User-Agent: *
    Disallow: /articleonlytext.aspx
    Allow: /
    Disallow: /search.aspx


    correct or not?
     
    Guitarkalle, Jan 18, 2009 IP
  2. shailendra

    shailendra Peon

    Messages:
    1,225
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    0
    #2
    yes it is absolutely correct
     
    shailendra, Jan 18, 2009 IP
    Guitarkalle likes this.
  3. pageloadtime

    pageloadtime Peon

    Messages:
    9
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I agree that is correct
     
    pageloadtime, Jan 19, 2009 IP
  4. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #4
    You could write it as written below:

    User-Agent: *
    Disallow: /articleonlytext.aspx
    Disallow: /search.aspx

    All the other pages will automatically allowed.
     
    manish.chauhan, Jan 20, 2009 IP