Do search engines index add-on domains as subfolders?

Discussion in 'Search Engine Optimization' started by webtry, Apr 9, 2006.

  1. #1
    Let's say i have a site:

    mysite.com

    and an add-on domain:

    myaddon.com (which is actually myaddon.mysite.com)


    I assume, if I don't post the subdomain link anywhere it is not indexed as subdomain, true?

    This is the real issue:

    Since I have a folder mysite.com/myaddon search engines normally index that directory as well.
    Should I disallow this with robots.txt?
    Sould this disallow effect the indexing of the add-on domain? (I assume not)

    Thanks.
     
    webtry, Apr 9, 2006 IP
  2. Jean-Luc

    Jean-Luc Peon

    Messages:
    601
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #2
    That's right.

    Only if there is somewhere a link pointing to it.

    As you cannot be sure there will never be a link to a "bad" URL, there are two possible approaches:
    - robots.txt to disallow access to URL's you do not want to be crawled;
    - .htaccess to redirect any access from a "bad" URL to a "good" URL.

    robots.txt is the best solution if there are no important links pointing to the "bad" addresses; .htaccess should be prefered otherwise.

    Jean-Luc
     
    Jean-Luc, Apr 10, 2006 IP
  3. webtry

    webtry Peon

    Messages:
    59
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    thanks, very useful info for me :)
     
    webtry, Apr 10, 2006 IP
  4. BILZ

    BILZ Peon

    Messages:
    1,515
    Likes Received:
    62
    Best Answers:
    0
    Trophy Points:
    0
    #4
    subdomains are seen as different sites.
     
    BILZ, Apr 10, 2006 IP
  5. trueman

    trueman Well-Known Member

    Messages:
    554
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    108
    #5
    Google see sub domain as different site (only Google)
     
    trueman, Apr 11, 2006 IP