Can someone please explain to me what this error means and how do I fix it? I have several blog sites on blogger.com and a diagnosis shows everything is ok but I get this message Urls restricted by robots.txt is there a switch or something where I can turn robots.txt on or off?
What diagnosis tool is giving you this error message? It is not necessarily bad for robots.txt to be blocking certain urls. Perhaps it is just blocking your cgi scripts folder. Try typing your domain in a web browser, followed by robots.txt. Then check which folder or files robots.txt is blocking. Also, if you haven't already done it, try adding your website to google webmaster tools. This will give you further information about which pages are being indexed. Or you could just do a Google search for site:www.mydomain.com That might not show every indexed page though, as it might exclude pages in their supplemental index.
This was done on Google webmaster tools, everything loads fine, I just get that message and didn't understand it.
Thanks to all of you who tried to help, seems the mistakes were coming from my labels, so I removed all labels but also noticed my adsense adds had all disappeared, then saw the new format at the top. You can no longer put adds in 3-4 places like you used to, instead you only have just one choice. So I've corrected all sites and now waiting to see what the next crawl will bring.