1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

How can i block Google bot alone

Discussion in 'robots.txt' started by illianafrazer, Feb 2, 2011.

0
  1. #1
    Hi Every one,

    i have a requirement where i have to block Google bot ALONE from reaching my whole website.


    What will be the correct robots.txt for it.
     
    illianafrazer, Feb 2, 2011 IP
  2. illianafrazer

    illianafrazer Well-Known Member

    Messages:
    393
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    138
    #2
    Will this be a correct one?

    # robots.txt for refusing Google bot alone
    User-agent: Googlebot
    Disallow: /
    User-agent: googlebot-image
    Disallow: /
    User-agent: googlebot-mobile
    Disallow: /
    User-agent: *
    Disallow:
     
    illianafrazer, Feb 2, 2011 IP
  3. illianafrazer

    illianafrazer Well-Known Member

    Messages:
    393
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    138
    #3
    Please let me know if any other Google agents are to be added? waiting for replies :(
     
    illianafrazer, Feb 2, 2011 IP
  4. ska_kashif

    ska_kashif Active Member

    Messages:
    31
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    91
    #4
    User-agent: Googlebot
    Disallow: /
     
    ska_kashif, Feb 8, 2011 IP
  5. fsdnetwork

    fsdnetwork Peon

    Messages:
    20
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Dear illianafrazer, the post#2 is the correct way to avoid google to crawl your site.
     
    fsdnetwork, Feb 9, 2011 IP