Please review my Robots.txt

Discussion in 'robots.txt' started by coolcow, Jul 17, 2007.

  1. #1
    Please review this Robots.txt , my site is http://www.kedoya.com


    User-agent: *

    Disallow: category/1/?ctp=
    Disallow: category/2/?ctp=
    Disallow: category/3/?ctp=
    Disallow: category/4/?ctp=
    Disallow: category/5/?ctp=
    Disallow: category/6/?ctp=
    Disallow: category/7/?ctp=
    Disallow: category/8/?ctp=
    Disallow: category/9/?ctp=
    Disallow: category/10/?ctp=
    Disallow: category/11/?ctp=
    Disallow: category/12/?ctp=
    Disallow: category/13/?ctp=
    Disallow: category/14/?ctp=
    Disallow: category/15/?ctp=
    Disallow: category/16/?ctp=
    Disallow: category/17/?ctp=
    Disallow: category/18/?ctp=
    Disallow: category/19/?ctp=
    Disallow: category/20/?ctp=
    Disallow: category/21/?ctp=
    Disallow: category/22/?ctp=
    Disallow: category/23/?ctp=
    Disallow: category/24/?ctp=
    Disallow: category/25/?ctp=
    Disallow: category/26/?ctp=
    Disallow: category/27/?ctp=
    Disallow: category/28/?ctp=
    Disallow: /?ctp=
    Disallow: /home/7/
    Disallow: /home/30/
    Disallow: /home/365/
    Disallow: /home/24/?ctp=
    Disallow: /home/7/?ctp=
    Disallow: /home/30/?ctp=
    Disallow: /home/365/?ctp=
    Disallow: /members/


    Thx,
    Andy
     
    coolcow, Jul 17, 2007 IP
  2. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #2
    the lines which is above will give you the same effect:)
     
    trichnosis, Aug 6, 2007 IP