HomeRun
Mar 25th 2008, 10:12 am
Is there something i disallowed u wouldn't disallow? is there something i missed to disallow
and why?
User-agent: *
Disallow: /ajax.php
Disallow: /ajax_cron.php
Disallow: /attachment.php
Disallow: /checkspelling.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /external.php
Disallow: /faq.php
Disallow: /global.php
Disallow: /image.php
Disallow: /joinrequest.php
Disallow: /login.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattatchment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /payment_gateway.php
Disallow: /payments.php
Disallow: /pdfthread.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /subcription.php
Disallow: /subcriptions.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php
Disallow: /admincp/
Disallow: /images/
Disallow: /modcp/
Disallow: /clientscript/
Disallow: /customavatars/
Disallow: /customprofilepics/
Disallow: /files/
Disallow: /install/
Disallow: /cpstyles/
Disallow: /images/
Disallow: /includes/
Disallow: /subscriptions/
Disallow: /attachments/
Sitemap: http://www.xxx.com/sitemap_index.xml.gz
and why?
User-agent: *
Disallow: /ajax.php
Disallow: /ajax_cron.php
Disallow: /attachment.php
Disallow: /checkspelling.php
Disallow: /cron.php
Disallow: /editpost.php
Disallow: /external.php
Disallow: /faq.php
Disallow: /global.php
Disallow: /image.php
Disallow: /joinrequest.php
Disallow: /login.php
Disallow: /misc.php
Disallow: /moderator.php
Disallow: /newattatchment.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /payment_gateway.php
Disallow: /payments.php
Disallow: /pdfthread.php
Disallow: /poll.php
Disallow: /postings.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /subcription.php
Disallow: /subcriptions.php
Disallow: /threadrate.php
Disallow: /usercp.php
Disallow: /usernote.php
Disallow: /admincp/
Disallow: /images/
Disallow: /modcp/
Disallow: /clientscript/
Disallow: /customavatars/
Disallow: /customprofilepics/
Disallow: /files/
Disallow: /install/
Disallow: /cpstyles/
Disallow: /images/
Disallow: /includes/
Disallow: /subscriptions/
Disallow: /attachments/
Sitemap: http://www.xxx.com/sitemap_index.xml.gz