I have this robots.txt file in my site root directory, but it's not working properly. User-agent: * Disallow: /wp/wp-admin/ Disallow: /wp/wp-content/ Disallow: /wp/wp-includes/ Code (markup): I put a request in webmaster tools to remove the wordpress /wp-content/plugins/ folder because it has been indexed, but I got this message: "our request has been denied because the webmaster of the site hasn't applied the appropriate robots.txt file or meta tags to block us from indexing or archiving this page" This means that the robots.txt isn't working. Can someone help me out with it please.
I believe that is not the correct path. maybe u should use something like this: User-agent: * Disallow: /cgi-bin Disallow: /wp-content/ Disallow: /wp-includes/ Disallow: /trackback/ Disallow: /wp-admin/ Disallow: /wget/ Disallow: /httpd/ Disallow: /i/ Disallow: /f/ Disallow: /t/ Disallow: /c/ Disallow: /j/ Disallow: /*? Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: */trackback/ Disallow: /pages/ Unless your website is in subdomain of wp. Not sure, just my thoughts.