Hello Guys please check my drupal robots.txt file , two days ago i disallowed urls containing node and forum but till now nothing districted all indexed in google please check www.mts-vienna.com/robots.txt
see this w w w . wordpress.org/robots.txt i suggest to use the same robots txt file and bychance if google indexed some URL that you don't want then you can also disable that URL ffrom the google webmaster tools
Since you updated the files just 2 days back, give some more time to Google to remove the files from its database. If you want to remove them in much speedy way, then log in to your Google webmaster accounts and remove the URLs manually.
User-Agent: * Allow: / Allow: /en/ Allow: /ar/ sitemap: http://www.mts-vienna.com/sitemap.xml You're forgetting your sitemap link and the closing / on Allow: /ar Most URL requests you submit to google will be removed within 12 hours in my experience.
yeah, I agree with everyone... the file looks correctly formatted to me.. According to Google webmaster tools it can take a few weeks if not longer.. (depending on how actively your site crawled).. patience! Sign up for Google Webmaster Tools, so you can get some more information about how to remove url's, block url's with your robots.txt file..