robots.txt and add-on domain

Discussion in 'Search Engine Optimization' started by h0mayun, Aug 14, 2011.

  1. #1
    hi guys
    i bought a domian name an added-on to my server in www (public html) directory.i had a forum in this directory and after adding a add-on domain i can see a folder named as domain name
    if i want to prevent search engines to show this directory like sub.domian.com in their index, should i disallow subdomain folder in robot.txt which exist in main directory?
    if so,can i still use robots.txt in subdomian directory to have crawling this directory with spiders with new domain name?
    sorry for bad english
     
    h0mayun, Aug 14, 2011 IP
  2. h0mayun

    h0mayun Peon

    Messages:
    32
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    bump
    i need answer :d
    plz help guys
    thanks
     
    h0mayun, Aug 14, 2011 IP
  3. sitehunter21

    sitehunter21 Well-Known Member

    Messages:
    190
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    115
    #3
    Just put robots.txt in the addon domain folder,
     
    sitehunter21, Aug 14, 2011 IP
  4. h0mayun

    h0mayun Peon

    Messages:
    32
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    tnx for reply
    yes i will do that
    but in robots.txt in main directory should i disallow the addon folder?
     
    h0mayun, Aug 14, 2011 IP
  5. sitehunter21

    sitehunter21 Well-Known Member

    Messages:
    190
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    115
    #5
    NO, just think of the addon folder as its own website and put the disallow in that folder
     
    sitehunter21, Aug 14, 2011 IP