hi I heard that the contents provided by the robots are not unique and it has no proper meaning.... If you use a robot which provides unique contents with proper sentences and meaning .............can you suggest me Thanks
U can check this url, i sure it will be too much useful for you............ http://googlewebmastercentral.blogspot.com/2007/03/using-robots-meta-tag.html
I'm not entirely sure what you mean if the contents are useful. robots.txt files are useful because they allows certain bots to be able or to not be able to crawl certain directories of your site. http://facebook.com/robots.txt Facebook's robots.txt file is a great example of how it can be useful assuming all of the bots they allow and disallow follow these guidelines that they've created for crawling facebook. As for the meta info you can add, you don't really need this since you can basically create the same thing using your robots.txt file. nofollow actually can hurt yuur SEO ranking so noindex would be a better option. Here is a good link on how to create a robots.txt file http://www.robotstxt.org/robotstxt.html
mate i was trying to say that the contents provided by the robots are don't have proper meaning......Will these contents help our site development