Robots.txt Please Check mine

This is my robots.txt

User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content
Disallow: /tag
Disallow: /category
Disallow: /author
Disallow: /page/
Allow: /

But Google still crawling and indexing the tag. Please help me. I'm using all in one seo pack for my wordpress blog and i set noindex for tag and categories from the very begining. But don't know what's wrong with my blog.

Above all i don't want to let google index my attatchment pages. Please suggest me a good robots.txt.

Thanks

 

Your robots file looks fine, have you considered blocking the googlebot with .htaccess?

 

no i didn't block google bot via .htaccess

 

Try this:

User-agent: *
Allow: /
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/
Disallow: /tag/
Disallow: /category/
Disallow: /author/
Disallow: /page/

sitemap: http://www.example.com/sitemap.xml

Code (markup):

Note: the sitemap uri must be the absolute link to your sitemap and you also need to have a space between the sitemap and the last entry. You also should close all of the directories you wish to block as well with a "/".

Oops, I forgot to mention that you can request that google take down a specific url that they have indexed. I believe you can do this through google webmaster

 

Ya i know that and i already requested them to remove those URLs. Thanks for this Tips I've updated my Robots.txt Hope it will solve my problem

 

try plugin for robots meta tag this will solve your problem

 

sir a also disallow to my admin files but that also crawled by google is that take time to remove urls from google or it will do as google crawl

 

use no-index on your tag.

 

where to use no-index. in which tag i have to use this. pls be explicative

 

You can change your blog links with rel="nofollow attribute then google will not crawl them..
for example <a href="http://yourdomain.com/page" rel="nofollow" >Link</a>
Hope this will work for you..