Help needed - ban robots from crawling redirect script

Hello,

I have a redirect script /go.php on my site.

It has a lot of different parameters.

For example,
/go.php?site=google
/go.php?site=yahoo
...

In the robots.txt, I write as following,
User-agent: *
Disallow: /go.php*

It seems Google has been banned from go.php,
But Msnbot still crawls go.php?site=google etc

Is there methods to ban msnbot?

Thanks a lot!

Bryan

 

Add to your robots.txt the following line

User-agent: MSNBot
Disallow: / 

Code (markup):

 

Copy the same thing and replace googlebot with msnbot?

 

Thanks for your reply.

I don't want to block msnbot from index the whole site, and I want to block /go.php?google etc.
This is the whole robots.txt

I didn't do anything special for googlebot.

 

I'm sorry, I should post this

User-agent: *
Disallow: /go.php* 

User-agent: MSNBot
Disallow: /go.php* 

Code (markup):

The implicit name of that crawler ensures the wildcard works for MSNbot. There is a workaround with mod_rewrite but I'm not sure about it after reading there are new robots.txt rules for MSN since the introduction of live.com

 

Thank you Trusted Writer.

I will give a try.

 

No problem, hope this helps

 

I checked robots.txt on Live Webmaster home,
http://webmaster.live.com/webmaster/RobotReportPage.aspx?FORM=JOWU

It says msnbot doesn't support wildcard characters.

 

Just used this code,

Will watch the result.

 

Thanks a lot for let us know and please update us if this way MSNbot refrain to index your page.