1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Do you use robots.txt on your forum community?

Discussion in 'Forum Management' started by ForgottenCreature, Jun 14, 2006.

0
  1. #1
    I'm thinking about using robots.txt on one of my communities, but I'm not sure if I should or not.
     
    ForgottenCreature, Jun 14, 2006 IP
  2. Art

    Art Peon

    Messages:
    711
    Likes Received:
    17
    Best Answers:
    0
    Trophy Points:
    0
    #2
    It's good for removing pages that won't help anyone (search.php etc, although I have found various sites through indexed search pages...). Remember that a badly implemented robots.txt can also totally kill your site...
     
    Art, Jun 14, 2006 IP
  3. disgust

    disgust Guest

    Messages:
    2,417
    Likes Received:
    133
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I contemplated adding it but decided against it. if search engines want to index random pages, I say they can go for it. I know I've landed on odd pages on forums before via search engines-- more visitors is a good thing to most people.
     
    disgust, Jun 14, 2006 IP
  4. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,333
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #4
    digitalpoint, Jun 14, 2006 IP
  5. Tekime

    Tekime Well-Known Member

    Messages:
    773
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    140
    Digital Goods:
    1
    #5
    I don't trust robots.txt to the end of the Earth, so I try to manage links pretty closely.

    I use a go.php file to redirect and track external links from my forums, and I disallow access in robots.txt.
     
    Tekime, Jun 15, 2006 IP