ian_ok
Mar 18th 2006, 8:33 am
I'm just revising my robots.txt file and was thinking should i ban a bot from indexing anything in my folder that I use as menus etc which are called by the php include command?
OR would this prevent them from indexing the pages that use those files? Which is every page on my site!
Thanks Ian
OR would this prevent them from indexing the pages that use those files? Which is every page on my site!
Thanks Ian