So I looked under "crawler access" at google webmasters and found this... http://i861.photobucket.com/albums/ab178/zenigma/robot.jpg How and should I remove this? I never added http://www.kajanova.com/robots.txt to my root folder... I don't know why its there. And I don't want to block access from google's crawlers.. can somebody explain this to me?
It is disallowing all the engines, you can delete it, you only need it if you need to block any specific engine. Just delete it, site should be fine without this.
This is not dissalowing any engines and Google wants you to have a robots.txt file... Where do you figure it is dissalowing.. The dissalow field is blank which means 0
I was just confused about it. I'm new to google webmasters and I noticed a robots.txt file, I looked in my root directory and found none. I added a blank robots.txt just in case. I'm good now, thanks for the help.