spiders.text & robot.text

Discussion in 'robots.txt' started by sck, Aug 11, 2006.

0
  1. #1
    What is the difference between spiders.text & robot.text.

    Please let me know your views.

    Thanks
     
    sck, Aug 11, 2006 IP
  2. Mr_Kumar

    Mr_Kumar Notable Member

    Messages:
    2,561
    Likes Received:
    374
    Best Answers:
    1
    Trophy Points:
    265
    Articles:
    4
    #2
    I know about robots.txt but I have not heard about spiders.text

    Please rephrase your question, I don't get it clearly.
     
    Mr_Kumar, Aug 11, 2006 IP
  3. sck

    sck Banned

    Messages:
    57
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Hi Kumar, yes I am talking about robots.text & spiders.text. I want to just know difference between them. Somebody told me that both are same. Is it true?
     
    sck, Aug 11, 2006 IP
  4. explorer

    explorer Well-Known Member

    Messages:
    463
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    110
    #4
    Two banned users!

    The answer to your question is here:

    http://forums.oscommerce.com/lofiversion/index.php/t112609.html

    spiders.txt and robots.txt have two very different purposes.

    spiders.txt is used only by osCommerce and should reside in your catalog/includes folder. If you enable the "Prevent Spider Sessions" option in osC admin, osC will not start a session for a visit by a spider identified by a "user agent" string that contains any of the strings in spiders.txt........
     
    explorer, Sep 15, 2006 IP