Subdomain crawled from main domain

Discussion in 'Apache' started by cupid, Aug 8, 2006.

  1. #1
    I have a site as a main domain and another site as a subdomain. When the search engine crawls, is it possible to crawl subdomain site from the main domain and have subdomain indexed under the main domain. How can you stop this
     
    cupid, Aug 8, 2006 IP
  2. SaN-DeeP

    SaN-DeeP Well-Known Member

    Messages:
    590
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    140
    #2
    what exactly do you meant here ?
     
    SaN-DeeP, Aug 8, 2006 IP
  3. cupid

    cupid Peon

    Messages:
    284
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I have the following:

    main_site.com
    site2.com

    Site2 is a subdomain. site2.main_site.com

    Question is can the spider crawl like this:
    First it crawls main_site.com and then jump to site2.com
    Like below:
    main_site.com -> site2.com

    In google index you have:

    main_site.com

    supplemental
    site2.com

    This is only possible if you have link from main_site.com to site2.com. Spider jumps from link to link. It doesn't go into very single folders in the main_site.com ?
     
    cupid, Aug 8, 2006 IP