Robots.txt Question - Same Server, Multiple Sites

Discussion in 'Google' started by jewelryzen, Sep 9, 2009.

0
  1. #1
    I have 5 sites all reading from the same /product-images/ directory on the root of my server, but I only want Google to crawl the folder for one site.

    How do I set that up correctly?

    Like this?

    User-agent: *
    Allow: /site/product-images/
    Allow: /product-images/
    Disallow: /site-2/product-images/
    Disallow: /site-3/product-images/
    Disallow: /site-4/product-images/
    Disallow: /site-5/product-images/


    site = the domain i want crawled
    site-2 through site-5 = sites i don't want crawled

    Any suggestions?
    Thanks.
     
    Last edited: Sep 9, 2009
    jewelryzen, Sep 9, 2009 IP
  2. seminar

    seminar Active Member

    Messages:
    226
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    51
    #2
    Complicated question .I annoyed .
    Why dont you use subdomain ?
     
    seminar, Sep 9, 2009 IP