FastFox Robots.txt block

Discussion in 'robots.txt' started by quaffapint, Feb 21, 2006.

0
  1. #1
    Is anyone out there using the FasterFox Robots.txt block (feature addded to latest FasterFox release) ? I added it to my existing Robots.txt file. I was just curious if anyone could see any detriments of this...?
     
    quaffapint, Feb 21, 2006 IP
  2. alifan

    alifan Peon

    Messages:
    46
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Isnt fasterfox a pluging not a full product?
     
    alifan, Mar 30, 2006 IP
  3. alifan

    alifan Peon

    Messages:
    46
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    What im saying is if its a plugin it will not change the browser agent string there for will look just like mozilla
     
    alifan, Mar 30, 2006 IP
  4. quaffapint

    quaffapint Active Member

    Messages:
    299
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    58
    #4
    apparently the latest release does pass this as the agent string for all it's grabbers...
     
    quaffapint, Mar 31, 2006 IP
  5. Jean-Luc

    Jean-Luc Peon

    Messages:
    601
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #5
    You mean you are using this in your robots.txt: 
    User-agent: Fasterfox
Disallow: /
    Code (markup):
    I do not see any real disadvantage in using this. It does not change anything for the non-Fasterfox users.

    It could disappoint some Fasterox users, but, if you add that in your robots.txt, that's probably because some of them overloaded your system.

    This is not related to user-agent issues.

    Jean-Luc
     
    Jean-Luc, Mar 31, 2006 IP