hey guys, Could anybody please tell me if this looks alright? I havent been crawled by google since I put this up a week ago and have been link building since. Cheers! User-agent: * Sitemap: http://www.goingonce.ie/sitemap.xml Disallow: /.protect/ Disallow: /admin/ Disallow: /images/ Disallow: /includes/ Disallow: /uploads/ Disallow: /add_listing_2.php Disallow: /add_listing_3.php Disallow: /add_listing_4.php Disallow: /add_listing_5.php Disallow: /contact.php Disallow: /contact_2.php Disallow: /create_both.inc.php Disallow: /create_both_new.inc.php Disallow: /delete.php Disallow: /delete_2.php Disallow: /delete_3.php Disallow: /delete_4.php Disallow: /delete_listing_photos_1.php Disallow: /edit.php Disallow: /edit_2.php Disallow: /edit_3.php Disallow: /edit_4.php Disallow: /edit_5.php Disallow: /edit_listing_add_photos.php Disallow: /edit_listing_add_photos_2.php Disallow: /edit_listing_photos_1.php Disallow: /edit_listing_photos_2.php Disallow: /edit_listing_photos_3.php Disallow: /forgot_access.php Disallow: /forgot_access_2.php Disallow: /getNextFilename5.php
Yes, everything looks fine. There are many more things which you to disallow. Disallow: / examplesite.com/index.html Disallow: /wp-content/plugins/ Disallow: /trackback/ (better if you do this) Still many locations which you can disallow. Just check what google is doing for their pages: http://google.com/robots.txt