i use this as my robots.txt file. is it right?

Discussion in 'robots.txt' started by towfiq71, Nov 24, 2012.

0
  1. #1
    I use this

    User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Sitemap: http://www.eduportalbd.com/sitemap.xml.gz

    as my wordpress site's robots.txt.

    is it ok?

    Experts only reply.
    :cool:
    Thanks .
     
    towfiq71, Nov 24, 2012 IP
  2. kashishjain

    kashishjain Peon

    Messages:
    27
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    you should write it in this order
    Sitemap: your sitmap url here
    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/


    There are many more things a robots.txt can do and you should learn more about it. I can send the robots.txt I use but am not able to posts links right now.
     
    kashishjain, Nov 24, 2012 IP
  3. ryan_uk

    ryan_uk Illustrious Member

    Messages:
    3,983
    Likes Received:
    1,022
    Best Answers:
    33
    Trophy Points:
    465
    #3
    The Wordpress robots.txt is dynamically generated, so you can't edit it without adding a plugin such as WP Robots Txt. However, the default robots.txt is fine. You best read up on what the robots.txt is actually for so that you can understand it:

    http://www.robotstxt.org/
     
    ryan_uk, Nov 24, 2012 IP
  4. seoteamvo

    seoteamvo Member

    Messages:
    46
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    38
    #4
    you should written in this order
    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Sitemap:
     
    seoteamvo, Nov 27, 2012 IP
  5. agitetech

    agitetech Peon

    Messages:
    122
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Nope its wrong ..you should write as
    User-agent:*
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Sitemap:
     
    agitetech, Dec 27, 2012 IP