Robots.txt Question

Discussion in 'Search Engine Optimization' started by calisonder, May 4, 2007.

  1. #1
    i understand that the robots.txt file must be placed in the root directory,
    i.e. www.yourdomain.com/robots.txt

    and won't work if u place it in a sub directory,
    i.e. www.yourdomain.com/subdirectory/robots.txt

    ------------------------------------------------

    But I want my site to be indexed, i just have a sub directory that i use to host verious unrelated files that i do not want indexed.

    How can I accomplish this?

    thanks
     
    calisonder, May 4, 2007 IP
  2. calisonder

    calisonder Peon

    Messages:
    93
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    nevermind i figured it out
     
    calisonder, May 4, 2007 IP
  3. YoungMaster

    YoungMaster Peon

    Messages:
    330
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #3
    You put the robots.txt file in your root directory. Then specify within that file which pages/folders you don't want indexed.

    *EDIT*
    Looks like you already figured it out. Glad to hear that.
     
    YoungMaster, May 4, 2007 IP