How to block dynamic pages by using robot.txt

Discussion in 'Search Engine Optimization' started by Georgtaylor, Mar 7, 2013.

  1. #1
    Hi, Friends
    Please describe how to block dynamic pages by using robot.txt
     
    Georgtaylor, Mar 7, 2013 IP
  2. spy india

    spy india Member

    Messages:
    50
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #2
    this is simple code if robot.txt
    user agent:*--(google bot-slurp-msn bot)
    allow:/
    disallow:/a.txt/b.jpeg
    allow:/a.txt/c.jpeg
     
    spy india, Mar 7, 2013 IP
  3. gotlivechat

    gotlivechat Member

    Messages:
    516
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    35