robots.txt for https

Discussion in 'robots.txt' started by scott.allerdice, Dec 13, 2010.

  1. #1
    Is there a separate way to build robots.txt file for https?
     
    scott.allerdice, Dec 13, 2010 IP
  2. JoeTheWebMan

    JoeTheWebMan Peon

    Messages:
    14
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Not a separate way, just use a separate robots.txt file for each protocol (http and https).

    Joseph
     
    JoeTheWebMan, Dec 19, 2010 IP
  3. scott.allerdice

    scott.allerdice Peon

    Messages:
    4
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    but what about the inner content?
     
    scott.allerdice, Dec 19, 2010 IP
  4. JoeTheWebMan

    JoeTheWebMan Peon

    Messages:
    14
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    It would work the same way as a regular robots.txt file would, just being in a separate directory for https.

    Joseph
     
    JoeTheWebMan, Dec 19, 2010 IP
  5. scott.allerdice

    scott.allerdice Peon

    Messages:
    4
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    ok thanks, let me try this and will let you know if i get something bad in it too.
     
    scott.allerdice, Dec 19, 2010 IP