googlebot, vbulletin, and robots.txt

[disgust]

normally I don't even bother with robots.txt- I figure I can spare some bandwidth for some extra traffic once it gets into the search engines...

but googlebot is really hammering my vbulletin- I'd like them to be able to view threads (and threads in the archive) fine, but the completely useless things that they keep on viewing I'd like to exclude. namely, the edit post, quote post, report a post to a moderator, etc.

does anyone know of a robots.txt for vbulletin 2 that'll just keep them looking at the actual threads, and not the useless pages they can't do anything with?

[digitalpoint]

I tried to do something similar when this forum first went up, but I ended up giving up and taking out the robots.txt file completely. The more content Google has, the better so I figure it's just one of those things with running a forum...

[vprp]

here's what i have...

User-agent: *
Disallow: /arcade.php
Disallow: /attachment.php
Disallow: /avatar.php
Disallow: /editpost.php
Disallow: /member.php
Disallow: /member2.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /private2.php
Disallow: /report.php
Disallow: /search.php
Disallow: /sendtofriend.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /admincp/
Disallow: /modcp/
Disallow: /images/
Disallow: /sendmessage.php
Disallow: /register.php
Disallow: /subscription.php

[disgust]

I tried to do something similar when this forum first went up, but I ended up giving up and taking out the robots.txt file completely. The more content Google has, the better so I figure it's just one of those things with running a forum...

was there any particular reason you gave up on it?

vprp: thanks, I might try that :)

[Help Desk]

More content is better serps and PR, so why bother?

[digitalpoint]

was there any particular reason you gave up on it?

vprp: thanks, I might try that :)
Because bandwidth really isn't all that expensive, and I rank well in Google for pages other than thread and post pages as well...