I need a robots.txt to allow converted urls

Discussion in 'robots.txt' started by sponge.nika, Sep 4, 2010.

0
  1. #1
    I have pages like this http://mydomain.com/posted.php?details=51 I convert the dynamic url to static like http://mydomain.com/details/51.html
    I need manage my robots.txt to allow index static pages, disallow others.
     
    sponge.nika, Sep 4, 2010 IP
  2. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #2
    If the ones you want to disallow always start with posted.php, do this:
    User-agent: *
Disallow: /posted.php
    Code (markup):
     
    digitalpoint, Sep 4, 2010 IP