Robots.txt vs. .htaccess

Discussion in 'robots.txt' started by imnocost, Sep 13, 2008.

0
  1. #1
    Whats the difference between using a robots.txt file vs using a .htaccess file?

    Mike
     
    imnocost, Sep 13, 2008 IP
  2. Kuldeep1952

    Kuldeep1952 Active Member

    Messages:
    290
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    60
    #2
    These are entirely different files.

    Robots.txt - This tells the Search engines which URLs should not be indexed.

    .htaccess - This file can achieve many functions, such as

    - Ban a particular IP or User-agent.
    - Redirect URLs
    - Rewrite URLs with SE friendly names etc
     
    Kuldeep1952, Sep 14, 2008 IP
  3. cadel

    cadel Peon

    Messages:
    16
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    robots.txt tells search bot to not index parts
    .htacess forces search bots to not visit some areas so they cant index
     
    cadel, Sep 19, 2008 IP
  4. Pompay

    Pompay Banned

    Messages:
    46
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Ok How to tell search bots not to index my proxified pages and how effective it is after immediately placing robots.txt in the server.
     
    Pompay, Sep 30, 2008 IP