Best Optimized Robots.Txt File F

I search google for too many article about robots.txt . All of them says different things. I want to learn the best robots.txt file for wordpress according to your experiences.
For example
Some of articles says to restrict tags. But all we know that tags are bringing good traffic to website. So why they are restricting them.
And also for example i have too many pictures on my blog their adress starting with
www.xxxx.com/wp-content/...pl
I'm using wordpress upload and they also restrict pictures.
Can someone share experiences and give their best robots.txt files?

 

I think that best robots.txt is empty robots.txt. Even image searchers can bring many visitor to you site... Of course it cost you few megabytes of traffic, but nowadays it's not so big problem I think...

 

I disallow the feeds as well as the trackback.

There are various combinations that one can use.

 

Do you have the link to the article? Here is what I block:

 

Andy Beard wrote a nice article on seo for competitive niches. There is a section on robots.txt that might interest you.

http://andybeard.eu/2007/06/wordpress-seo-masterclass-for-competitive-niches.html

Good luck

 

I checked all of them at final i created one for me check it if you have suggestions
http://www.carantina.com/robots.txt

 

i wouldnt do that, either have a robots.txt that allows all (or disallows certain parts) or have no robots.txt to allow all.

a blank robots.txt will confuse the bots.

 

Instead of robots.txt ucan use robots meta in head section

<?php if(is_single() || is_page() || is_home()) { ?> 
    <meta name="googlebot" content="index,noarchive,follow,noodp" /> 
    <meta name="robots" content="all,index,follow" /> 
  <meta name="msnbot" content="all,index,follow" /> 
<?php } else { ?> 
    <meta name="googlebot" content="noindex,noarchive,follow,noodp" /> 
    <meta name="robots" content="noindex,follow" /> 
  <meta name="msnbot" content="noindex,follow" /> 
 
<?php }?>

PHP: