problems. 1) google shows that my robots.txt is unreachable. though it suceeds to find it. and it can be viewied www.ultimate4m.com/robots.txt 2) shows a cross mark in my uploaded site map. 3) does not crawl my page. it crawl my page in july but didnt do in august.
www.ultimate4m.com/robots.txt/ is really unreachable. Don't forget to add "/" in the end of URL as it's done at your screenshot. The question is why the crawler attempts to reach the file in this URL format. May be some problem with .htaccess? BTW, can other search engines access this file or the problem is only with Google?
Kindly check for the possible errors with the sitemap mentioned on this link: http://www.google.com/support/webmasters/bin/answer.py?answer=35738 Hope this helps.
1) please remove Sitemap: http://www.ultimate4m.com/sitemap.xml.gz from your robots.txt file. 2) don't add "/" at the end of .txt because it is file not the folder so "/" doesn't come at the end. 3) Complete survey popup when visiting your website, you need to remove that. (that could be causing the problem)
When you place a URL in the robots.txt file you are actually telling the search engine crawler that you do not want this page to be indexed or crawled. Usually the pages that you would place here are the printer friendly pages of your websites if any .