since my website is new i was trying to submit searching engines but some of them are saying sitemap.xml is missing or it seems your website doesn't have robots.txt like that and i am not expert for these things. so what i am wondering is are sitemap.xml and robots.txt are important to get a good rank from searching engines? if you explain easily that will help full. sorry for my bad english!
Sitemap and Robots are comes under on page optimization in search engine optimization process. Both factors are important according to user or search engine crawler. Sitemap: In simple words sitemap is a list of pages of website accessible to crawler or users. It having two type one is sitemap.xml and another is sitemap.html which help user or crawler to access all the web page details into one page called sitemap. It showing tree structure of all the pages available on website. Robots.txt: Robots.txt is a part of robots exclusion standard who tell web robots to how to index a site. In simple word we can say robots.txt is used to hide the page from crawler which we don't want to index that page into Google through coding. Hope you will understand about sitemap and robots.txt and if not then you can take a help of google webmaster help where you can get answer of all your questions easily! Have Fun
Hi, Robots.txt is important when you need any webpage blocked by cache in search engine and sitemap.XML is really a important factor for cache all the webpage in search engine.
if you use a sitemap index file (where the main one points to sub-sitemaps), you will need to expose every sitemap in the robots.txt file explicitly as live/msn does not seem to honour an index list.