robots.txt help needed

Hello everyone,

I have a forum whose robots.txt I have made and placed at http://www.funwadi.com/robots.txt which Google is successfully accessing and blocking those which I have disallowed.

Now I wanted to block profile pages of members which Google is indexing at a rapid pace. I just don't want Google to index profile pages. Now the problem is that profile pages are in this format:-

http://www.funwadi.com/forum/member2.html
http://www.funwadi.com/forum/member3.html
http://www.funwadi.com/forum/member4.html
http://www.funwadi.com/forum/member5.html

and so on. I have over 43,000 registered users and I don't want Google to index profile pages so what I should enter in robots.txt file so that Google won't follow the above members pages.

Thanks a bunch in advance

AbdulBasit Makrani

 

http://www.seobook.com/archives/001329.shtml

 

Thanks for the link. I didn't understand very well so can you please tell that should I add the following code in my robots.txt ?

User-agent: Googlebot
Disallow: /*sort=member

or

User-agent: Googlebot
Disallow: /*member

or can you please write the code for my above URLs to be added in robots.txt

 

http://www.seoresource.net/robots-metatags.htm

 

Thanks for this but that's not the way to answer by providing URL's.

I know how to block or allow any specific URL or folder but what I have asked in my 1st post is quite different.

Anyone there who can help me by telling what exactly to add in robots.txt file instead of providing just URLs!

 

At least someone can tell me what exactly to enter in robots.txt to block the above URL's for Google. There are over 43,000 member pages which I cannot enter 1 by 1 in robots.txt so there must be some entry which has to be added which will block all member pages.

Please someone help me.

 

Anyone can guide better?

 

hi,

u can find it any way for e.g www.example.com/robots.txt, u will get better one

 

What do you mean?