SE's indexing subfolder in as well as subdomains.

Discussion in 'Search Engine Optimization' started by Alvin, Aug 3, 2007.

  1. #1
    Hello friends,

    I just found out today that Search engines are indexing sub folder of a site. Its acutaly a subdomain. but now subfolder and subdomains are beging indexed now.

    How can I stop subfolder from being indexed?

    here is my site structure.
    http://dir.mysite.com

    and search engines have indexed more than 1000 pages for http://www.mysite.com/dir

    how should i stop it? Robots.txt or there is any other way?
     
    Alvin, Aug 3, 2007 IP
  2. Doug the Great

    Doug the Great Peon

    Messages:
    548
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Doug the Great, Aug 3, 2007 IP
  3. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #3
    you must block that bot wiht your robots.txt file
     
    trichnosis, Aug 4, 2007 IP
  4. priyakochin

    priyakochin Banned

    Messages:
    4,740
    Likes Received:
    138
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Edit robot.txt files.
    This can help u.

    Do it fast ; bcoz if ur folders have some valuable docs this can help hackers!
     
    priyakochin, Aug 4, 2007 IP