Help me with Wordpress' robots.txt?

Discussion in 'Search Engine Optimization' started by michael.aulia, Feb 19, 2008.

  1. #1
    Hello, someone was helping me to setup robots.txt for my blog. The file that he gave me contains:

    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /wp-content/
    Disallow: /author/
    Disallow: /wp-
    Disallow: /2007
    Disallow: /2008
    Disallow: /page/
    Disallow: /archives/
    Disallow: /trackback/
    Disallow: /feed/
    Disallow: /tag/
    Disallow: /search-result/
    Disallow: /smilies/
    Disallow: /uploaded-images/
    Disallow: /wp-au-backup/
    ###########################
    User-agent: Mediapartners-Google*
    Disallow:
    ###########################
    User-agent: Googlebot-Image
    Allow: /wp-content/uploads/
    Allow: /uploaded-images/


    Do you guys think this is ok? Also, my blog is located under a sub directory...should I put this file on the root domain? (public_html/) or on the blog's root? (public_html/blogs/) :confused:
     
    michael.aulia, Feb 19, 2008 IP