Hello, I have these simple questions about the robots.txt file and how it affects SE robots' behavior. I hope I'll get some answers. 1- If I disable the directory /photos in my robots.txt file and then someone posts a dirtect link from his website to mine using "http://mysite.com/photos?img=76" now would SE robots see my robots.txt file before they directly visit the page in the last link and so they don't visit the page because /photos is disabled in robots.txt, or they (SE robots) would follow the direct link to the page and don't see my robots.txt file which means that the SE robot will see that page? (I am talking about what SHOULD happen here. I know that SE robots may sometimes ignore the robots.txt file). 2- Does a robots.txt file in the main root directory of my domain have any effects on other subdomains? Must each subdomain has its own seperate robots.txt file?
1) if your robots.txt is blocking a directory, they won't ever go into it. 2) each domain/subdomain is its own domain, so yes, it needs to be in the root for each domain/subdomain.