Is my robots fine?

Discussion in 'robots.txt' started by Vebtools, Dec 2, 2009.

  1. #1
    Vebtools, Dec 2, 2009 IP
  2. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #2
    This is absolutely fine if you really want to block all mentioned pages or directories
     
    manish.chauhan, Dec 3, 2009 IP
  3. Vebtools

    Vebtools Well-Known Member

    Messages:
    2,619
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    145
    #3
    Thanks!! atleast some one reply in this section :p
     
    Vebtools, Dec 3, 2009 IP
  4. redesignunit

    redesignunit Peon

    Messages:
    467
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    your robots.txt correct
     
    redesignunit, Dec 4, 2009 IP
  5. Sara Tancredi

    Sara Tancredi Peon

    Messages:
    18
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Disallow: /page/9/&rurl=translate.google.com&lang=en&usg=ALkJrhia-th_pXXvgPkDAuvQHlpx9t0b3w
    Disallow: /page/9/&rurl=translate.google.com&lang=en&usg=ALkJrhif-SOO4sRp-PZMpPDL3eo-OFccvQ
    Disallow: /page/9/&rurl=translate.google.com&lang=en&usg=ALkJrhigNISfP1MEwmrCSj4sLpvdQf7hUQ
    Disallow: /page/9/&rurl=translate.google.com&lang=en&usg=ALkJrhinzN43EYIbzoz1UX8N2KBlnkgJgw
    Disallow: /page/9/&rurl=translate.google.com&lang=en&usg=ALkJrhj2hZqcUGYmhC1IXWTCAh9NYgVlhw
    Disallow: /page/9/&rurl=translate.google.com&lang=en&usg=ALkJrhjyrpApUcx2NVvItaqd-2gZ6A0NTw
    
    PHP:
    Disallow: /page/9/*

    You can shortcut a lot of this ropots
     
    Sara Tancredi, Dec 4, 2009 IP