Suppose we have created a folder in root directory and also no restricted by robots.txt, So can you tell me this empty folder will crawl or not by search engines in Google, Yahoo, Bing etc...? I got this question from one of my colleague. I have no ideas about this question, so need you valuable answers. Give me some reference if this happening I mean crawling.
Crawler do not read directories. As they don't have the auhority required by the host operating system to do so.
Crawler crawl the folder, but it will suddenly come outside from the empty folder, as it not found anything.