please help me!!!

Discussion in 'robots.txt' started by rusting, Jan 22, 2007.

0
  1. #1
    Hi,
    I have uploaded my site on hostgator, but there is no "robots.txt" file. However there is one .htaccess file. Is this the same as robot or should i upload another one?
    Regards
     
    rusting, Jan 22, 2007 IP
  2. dhruv37

    dhruv37 Well-Known Member

    Messages:
    3,222
    Likes Received:
    195
    Best Answers:
    0
    Trophy Points:
    165
    #2
    .htaccess & robots.txt file both are different things.
    so you need to upload both .htaccess and robots.txt file
     
    dhruv37, Jan 22, 2007 IP
  3. lookzovt

    lookzovt Peon

    Messages:
    38
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Probably you don't need robots.txt. It can helps you to disallow search engines to index some files.
    .htaccess file is apache configuration directives for directory (error pages, authorization, etc).
     
    lookzovt, Jan 28, 2007 IP
  4. eTIME

    eTIME Banned

    Messages:
    128
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    both are differnt files, for seo robot.txt
     
    eTIME, Jan 29, 2007 IP
  5. jonbt

    jonbt Peon

    Messages:
    11
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    In your robots.txt file it is helpful to specify directorys that you don't want legitimate search engines to search.

    The theory is that by only allowing google to search good areas of your site you get a better ranking.

    Example:

    
User-agent: *
Disallow: /cgi-bin/
Disallow: /admin/
Disallow: /stats/
Disallow: /dh_
Disallow: /*?*
    Code (markup):
     
    jonbt, Jan 30, 2007 IP