Is this valid?

Discussion in 'robots.txt' started by AHA7, May 8, 2007.

  1. #1
    Hello,

    Can I use the following to define googlebot?

    User-agent: google

    Will Googlebot (and other user agents that start with the string "google") follow the instructions following that line? Is it case sensetive or not?
     
    AHA7, May 8, 2007 IP
  2. Spartan_Strategy

    Spartan_Strategy Peon

    Messages:
    197
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #2
    I am not sure what your aiming to do...keep in mind trying to trick the google bot is something that can get you baned from google.
     
    Spartan_Strategy, May 10, 2007 IP