How to block a sub domain from crawling??

Discussion in 'Search Engine Optimization' started by AmitDobhal, Oct 22, 2006.

0
  1. #1
    Hello Friends,
    Please tell me how to block a sub domain from crawling by SEs?
    We are using a sibdomain of our site as Forum for our Clients.
    I want that SEs should not crawl this subdomain.
    What shoud I do?
    Can I use robots.txt file for this?
    If yes, then how??
    Waiting for your valuable suggestions.
     
    AmitDobhal, Oct 22, 2006 IP
  2. dam_sid

    dam_sid Banned

    Messages:
    241
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #2
    yes you are right, go for robot.txt and just find out the syntex and disallow all the pages of your sub domain.
     
    dam_sid, Oct 23, 2006 IP
  3. MattUK

    MattUK Notable Member

    Messages:
    6,950
    Likes Received:
    377
    Best Answers:
    0
    Trophy Points:
    275
    #3
    Just use,

    User-agent: *
    Disallow: /subdomain_directory/
     
    MattUK, Oct 23, 2006 IP
  4. AmitDobhal

    AmitDobhal Peon

    Messages:
    104
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Thanks Matt for your reply.
    I guess, this Disallow: /subdomain_directory is for blocking folders and not for subdomain or I may be wrong.
    Is this querry same for Folders and Subdomain??
    Please Reply.
     
    AmitDobhal, Oct 23, 2006 IP
  5. Cryogenius

    Cryogenius Peon

    Messages:
    1,280
    Likes Received:
    118
    Best Answers:
    0
    Trophy Points:
    0
    #5 
    User-agent: *
Disallow: /
    Code (markup):
    Put this as your robots.txt on your subdomain.
     
    Cryogenius, Oct 23, 2006 IP