Is there something i disallowed u wouldn't disallow? is there something i missed to disallow and why? User-agent: * Disallow: /ajax.php Disallow: /ajax_cron.php Disallow: /attachment.php Disallow: /checkspelling.php Disallow: /cron.php Disallow: /editpost.php Disallow: /external.php Disallow: /faq.php Disallow: /global.php Disallow: /image.php Disallow: /joinrequest.php Disallow: /login.php Disallow: /misc.php Disallow: /moderator.php Disallow: /newattatchment.php Disallow: /newreply.php Disallow: /newthread.php Disallow: /online.php Disallow: /payment_gateway.php Disallow: /payments.php Disallow: /pdfthread.php Disallow: /poll.php Disallow: /postings.php Disallow: /printthread.php Disallow: /private.php Disallow: /profile.php Disallow: /register.php Disallow: /report.php Disallow: /reputation.php Disallow: /search.php Disallow: /sendmessage.php Disallow: /subcription.php Disallow: /subcriptions.php Disallow: /threadrate.php Disallow: /usercp.php Disallow: /usernote.php Disallow: /admincp/ Disallow: /images/ Disallow: /modcp/ Disallow: /clientscript/ Disallow: /customavatars/ Disallow: /customprofilepics/ Disallow: /files/ Disallow: /install/ Disallow: /cpstyles/ Disallow: /images/ Disallow: /includes/ Disallow: /subscriptions/ Disallow: /attachments/ Sitemap: http://www.xxx.com/sitemap_index.xml.gz
Why would you disallow your FAQ ? To me thats an important part of your site. allow: /search.php allow: /poll.php ....etc
faq isn't an important part of 98% of vBulletin sites. Here is an vBulletin robots.txt thats pretty much the standard