robot.txt question

Discussion in 'Programming' started by saturn100, Mar 12, 2010.

  1. #1
    Whats the best way using robot.txt file to stop google indexing pdf pages

    Thanks
     
    saturn100, Mar 12, 2010 IP
  2. NeoCambell

    NeoCambell Peon

    Messages:
    456
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
  3. saturn100

    saturn100 Well-Known Member

    Messages:
    465
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    111
    #3
    thanks man
     
    saturn100, Mar 15, 2010 IP
  4. amuthavalli

    amuthavalli Peon

    Messages:
    110
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    http://www[dot]robotstxt[dot]org/robotstxt.html


    check this..........

    User-agent: googlebot
    Disallow: /~joe/junk.html
    Disallow: /~joe/foo.html
    Disallow: /~joe/bar.html
     
    amuthavalli, Mar 19, 2010 IP