How to prevent dynamic URLs from indexing using robots.txt ?

Discussion in 'robots.txt' started by naviarora2007, Dec 10, 2009.

0
  1. #1
    naviarora2007, Dec 10, 2009 IP
  2. RectangleMan

    RectangleMan Notable Member

    Messages:
    2,825
    Likes Received:
    132
    Best Answers:
    0
    Trophy Points:
    210
    #2
    Sign up for google webmaster tools. They have some things you can do in their interface.

    Also consider adding rel=nofollow to wherever those links exist.
     
    RectangleMan, Dec 11, 2009 IP
  3. youssefedwardsaber

    youssefedwardsaber Active Member

    Messages:
    254
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    51
    #3
    try using disallow /jobs statement . i think it will work but it will block the jobs directory entirely.
     
    youssefedwardsaber, Dec 13, 2009 IP
  4. naviarora2007

    naviarora2007 Active Member

    Messages:
    163
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    58
    #4
    Thanks for the replies....
    Both solutions can't be applied :(

    i don't want my whole jobs directory to disappear from google.

    when i add "nofollow" on these dynamic links...i am getting a php syntax error as these urls are generated by a wordpress script called "the wordpress bar"
     
    naviarora2007, Dec 15, 2009 IP