How can i block Google bot alone

Discussion in 'robots.txt' started by illianafrazer, Feb 2, 2011.

0
  1. #1
    Hi Every one,

    i have a requirement where i have to block Google bot ALONE from reaching my whole website.


    What will be the correct robots.txt for it.
     
    illianafrazer, Feb 2, 2011 IP
  2. illianafrazer

    illianafrazer Well-Known Member

    Messages:
    393
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    138
    #2
    Will this be a correct one?

    # robots.txt for refusing Google bot alone
    User-agent: Googlebot
    Disallow: /
    User-agent: googlebot-image
    Disallow: /
    User-agent: googlebot-mobile
    Disallow: /
    User-agent: *
    Disallow:
     
    illianafrazer, Feb 2, 2011 IP
  3. illianafrazer

    illianafrazer Well-Known Member

    Messages:
    393
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    138
    #3
    Please let me know if any other Google agents are to be added? waiting for replies :(
     
    illianafrazer, Feb 2, 2011 IP
  4. ska_kashif

    ska_kashif Active Member

    Messages:
    31
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    91
    #4
    User-agent: Googlebot
    Disallow: /
     
    ska_kashif, Feb 8, 2011 IP
  5. fsdnetwork

    fsdnetwork Peon

    Messages:
    20
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Dear illianafrazer, the post#2 is the correct way to avoid google to crawl your site.
     
    fsdnetwork, Feb 9, 2011 IP