Robots.txt Allow/ Disallow Dynamic Pages

Discussion in 'robots.txt' started by sameerseo, Mar 26, 2012.

0
  1. #1
    Hello,

    Please help me regarding the following errors which comes in my webmaster tool and I want that search engine not to attempt to visit these urls:

    1. http://www.abc/fabrics.html?page=sh...page=flypage.tpl&product_id=245&category_id=1
    2. http://www.ABC.COM/index2.php?option=com_content&view=article&id=17

    3. http://www.ABC.com/index2.php?optio...output=pdf&product_id=243&category_id=1&pop=1
    If I implement the following code in Robots.txt file:
    1. Disallow: /?page=*& (Is by applying this in Robots.txt file we tell Search engine not to attempt this URL ?)
    2. Disallow: /?option=*& (Is by applying this in Robots.txt file we tell Search engine not to attempt this URL ?)
    3. Disallow: /index2.php? (Is by applying this in Robots.txt file we tell Search engine not to attempt index2.php URL?)

    I want that search engine not to attempt these dynamic pages.

    Thanks
     
    sameerseo, Mar 26, 2012 IP
  2. tiffanywilliams12i2

    tiffanywilliams12i2 Peon

    Messages:
    164
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    it might be possible. never seen a dyanmic robots.txt file before
     
    tiffanywilliams12i2, Apr 10, 2012 IP