how to install a robots.txt for a wordpress blog ?

I wanted to add an robots.txt file to my wordpress blog http://balumusings.com/
Is it possible to write a robots.txt file to prevent search engines from indexing specific ,not all, posts in my blog and how it would look like ?

thank you
your help will be greatly appreciated

 

Yes it is possible and it would look something like this:

or whatever you want. If you just simply put disallow: / it will keep it from indexing all pages. If you want specific pages you can put it like i did in the first disallow or if you want to keep the bots from accessing archive pages (or category pages) it would look something like the second disallow I put in the example.

 

is there any plugin available for it ?

 

For wordpress, yes.

http://wordpress.org/extend/plugins/google-sitemap-generator/

 

k . thanks a lot I will check it out ...

 

Valve-Hosting, was this the link you meant to type? http://adambrown.info/b/widgets/kb-robots-txt/

 

Hello

I did it this way

I installed the plugin "PC Robots.txt Wordpress plugin"

Then I go to the menu of this in Wordpress. There I can add my own Robot.txt code.


Here ist my robot.txt I have added in my wordpress Blog. Maybe you like it


Regards
seobunny.de

 

You can also do it manually.

Just upload a robots.txt file to the root of your domain.

 

create a txt file in notepad editor and disallow the directroy and files u dont want search engine indexed and save it with robots.txt and uplaod it into the root of the server ................

 

Thanx for the info

 

yes i am agree with Valve-Hosting's using plug ins in wordpress is batter and its worked easily with word press.but i think more better is stop using word press with robot.txt

 

so for i have not used wordpress website for seo. for updating mata tags for each page. what plugin i want to install