Block whole site from Google

Discussion in 'robots.txt' started by websavy, Jul 17, 2008.

  1. #1
    Hi

    I want to block my whole site from major search engine bot (Google, yahoo and MSN), so I have putted following code at robots.txt file :-

    # go away
    User-agent: *
    Disallow: /
    HTML:
    Please let me know if this code is ok or not.

    Regards
    Waby
     
    websavy, Jul 17, 2008 IP
  2. SEO4U

    SEO4U Peon

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Yes, Its fine
     
    SEO4U, Jul 19, 2008 IP
  3. pr0t0n

    pr0t0n Well-Known Member

    Messages:
    243
    Likes Received:
    10
    Best Answers:
    10
    Trophy Points:
    128
    #3
    will block all bots with that rule, and yup it will work for google bot also :rolleyes:
     
    pr0t0n, Jul 19, 2008 IP
  4. ASPkit

    ASPkit Peon

    Messages:
    53
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Yes that works - The Disallow: / does the trick.
     
    ASPkit, Jul 19, 2008 IP
  5. david432111

    david432111 Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Yes that will block all bots.
     
    david432111, Jul 20, 2008 IP
  6. catanich

    catanich Peon

    Messages:
    1,921
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    0
    #6
    That will do it.
     
    catanich, Aug 21, 2008 IP