Does this block all bots?

Discussion in 'Google' started by edual200, Jul 17, 2008.

0
  1. #1
    Does this block all bots from entire site?

    User-agent: *
    Disallow:

    Or does it have to be like this

    User-agent: *
    Disallow:/
     
    edual200, Jul 17, 2008 IP
  2. eibmoz

    eibmoz Peon

    Messages:
    70
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Using this has worked for me.

    User-agent: *
    Disallow: /
     
    eibmoz, Jul 17, 2008 IP
  3. InfoSmith

    InfoSmith Peon

    Messages:
    884
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #3
    User-agent: *
    Disallow:

    means no disallow, means bots go everywhere

    User-agent: *
    Disallow:/

    mean bots blocked the / and everything under /, means block everything
     
    InfoSmith, Jul 17, 2008 IP
  4. stayl

    stayl Guest

    Messages:
    69
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    User-agent: *
    Disallow:/
     
    stayl, Jul 17, 2008 IP
  5. enous

    enous Well-Known Member

    Messages:
    1,500
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    158
    #5

    The key..LOL
     
    enous, Jul 17, 2008 IP