Looking for a simple answer

Hi,

wanted to check if this is the right way i should have my robots.txt file for my site http://www.realpracticesolutions.com

User-agent: *
Disallow:
Disallow: /cgi-bin/
Sitemap: http://realpracticesolutions.com/google_sitemap.xml.gz


thanks for all the help

David

 

Yep thats the right way. You wont have the cgi-bin indexed that way

 

yup there is not any problem in that format. put this file on root and carry on

 

David, in your example you don't need empty "Disallow: ".
And your way to the sitemap looks wrong: it it xml-file, it's extention must be xml, so you don't need .gz at the end.

Right robots.txt for you:

 

Thanks guys

That is how the sitemap shows in the browser address bar.
should I just change it to xml

 

I was actualy told to write it like this, don't even know why I am excluding the cgi-bin file
Plus why should I have the robots file if i really don't need to hide anything???
Should I still have it?