stop spiders from indexing?

Discussion in 'Search Engine Optimization' started by wckd, Feb 15, 2008.

0
  1. #1
    is there a way to stop spiders from indexing a forum without disabling the guest area?
     
    wckd, Feb 15, 2008 IP
  2. dylanphelan

    dylanphelan Active Member

    Messages:
    86
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    91
    #2
    can't you use a robots.txt file?
     
    dylanphelan, Feb 15, 2008 IP
  3. wckd

    wckd Active Member

    Messages:
    711
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    80
    #3
    what would i put in the file though?
     
    wckd, Feb 15, 2008 IP
  4. mixke

    mixke Prominent Member

    Messages:
    5,917
    Likes Received:
    590
    Best Answers:
    0
    Trophy Points:
    310
    #4
    Yep! you can do it by using robots.txt file. Check that section @ forum and you will find some information there.
     
    mixke, Feb 15, 2008 IP
  5. poseidon

    poseidon Banned

    Messages:
    4,356
    Likes Received:
    246
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Put this in robots.txt

    I haven't used the code ever (I loves googlebot) so first check with other resources. There is a whole DP section devoted to robots.txt - http://forums.digitalpoint.com/forumdisplay.php?f=50
     
    poseidon, Feb 15, 2008 IP