1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

spiders.text & robot.text

Discussion in 'robots.txt' started by sck, Aug 11, 2006.

0
  1. #1
    What is the difference between spiders.text & robot.text.

    Please let me know your views.

    Thanks
     
    sck, Aug 11, 2006 IP
  2. Mr_Kumar

    Mr_Kumar Notable Member

    Messages:
    2,561
    Likes Received:
    374
    Best Answers:
    1
    Trophy Points:
    265
    Articles:
    4
    #2
    I know about robots.txt but I have not heard about spiders.text

    Please rephrase your question, I don't get it clearly.
     
    Mr_Kumar, Aug 11, 2006 IP
  3. sck

    sck Banned

    Messages:
    57
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Hi Kumar, yes I am talking about robots.text & spiders.text. I want to just know difference between them. Somebody told me that both are same. Is it true?
     
    sck, Aug 11, 2006 IP
  4. explorer

    explorer Well-Known Member

    Messages:
    463
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    110
    #4
    Two banned users!

    The answer to your question is here:

    http://forums.oscommerce.com/lofiversion/index.php/t112609.html

    spiders.txt and robots.txt have two very different purposes.

    spiders.txt is used only by osCommerce and should reside in your catalog/includes folder. If you enable the "Prevent Spider Sessions" option in osC admin, osC will not start a session for a visit by a spider identified by a "user agent" string that contains any of the strings in spiders.txt........
     
    explorer, Sep 15, 2006 IP