How important are robots.txt and .htaccess files?

Discussion in 'Search Engine Optimization' started by creative_007, Jan 25, 2014.

0
  1. #1
    I am in the process of setting up a new wordpress blog after a long time and am a bit confused about robots.txt and .htaccess. Some time back when I had set up my first blog, I remember reading that these two files were important (with regards to google and seo) but I am not sure what it was and what I am supposed to do now. I know the question sounds a bit stupid but will be grateful for any help regarding this...am I supposed to let those two files be as they are or should I be doing some editing? (installed wordpress using fantastico)
     
    creative_007, Jan 25, 2014 IP
  2. ash1ey82

    ash1ey82 Active Member

    Messages:
    588
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    88
    #2
    I don't think .htaccess affects the SEO much but the robots.txt is important.
     
    ash1ey82, Jan 25, 2014 IP
  3. Akhil Swatantra

    Akhil Swatantra Well-Known Member

    Messages:
    122
    Likes Received:
    2
    Best Answers:
    1
    Trophy Points:
    113
    Digital Goods:
    1
    #3
    Robots.txt is important for seo and you check this article :- http://tools.seobook.com/robots-txt/

    and if you are using wordpress platform so you can use SEO Yoast For SEO.
     
    Akhil Swatantra, Jan 25, 2014 IP
  4. patco

    patco Well-Known Member

    Messages:
    2,035
    Likes Received:
    47
    Best Answers:
    17
    Trophy Points:
    100
    #4
    Robots.txt is useful... I am almost sure you don't need the .htaccess file unless you are writing your website in PHP or any other programming language! ;)
     
    patco, Jan 25, 2014 IP
  5. ash1ey82

    ash1ey82 Active Member

    Messages:
    588
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    88
    #5
    Only reason I use the .htaccess is for mod_rewrite.
     
    ash1ey82, Jan 26, 2014 IP
  6. sayjohn

    sayjohn Member

    Messages:
    82
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    48
    #6
    According to the Google webamasters if you want to crawl all the webpages to the Google. You do not need the robots.txt file. It is used when you block the some content and page on the Google.
     
    sayjohn, Jan 26, 2014 IP
  7. santhoshreddi

    santhoshreddi Active Member

    Messages:
    168
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    53
    #7
    Both are no need for your website,
    If you want to stop/block any pages or links from your website, you can use robots.txt to stop crawl by the Google bot.
     
    santhoshreddi, Jan 27, 2014 IP