What an ideal website should contain like sitemap, robots.txt, 404 error pages and similar things. Can anyone tell me about a complete list?
robots.txt is not useful tool, so ideal site is not is need of it 404 error page, can redirect to your homepage Search tool and navigation are the most important things, which you should have on your website. Your visitors (include google bots) should be able to see every page with not more than 2 clicks from your index page.
you are right my friends but I really want something like a report for a website. Its like if i want to point out things , what are missing and what are available structure wise.
An ideal site must contain: 1) robots.txt file as it is the first thing that crawler looks for. even if you want all the pages of your site to get indexed use it and use an entry so as to enable the crawler to crawl all the pages. moreover, a sitemap entry in the robots file will immediately tell the crawler about the sitmap's address. eg User-Agent: * Allow: / Sitemap: http://www.xyz.com/sitemap.xml 2) xml sitemap which allows crawler to know about all the pages present on the website. 3) HTML sitemap which enables user to browse the website with ease. 4) If you are providing your address on the website, do register on Google Maps. 5) Text links. 6) Breadcrumb link structure. 7) Intuitive UI design. 8) Good and helpful content. Moreover, the content should compel the user to further browse the website. 9) Disable "hotlinking" so that no one can sabotage your server's bandwidth 10) Proper use of h1 and h2 tags. don't use 'h' tags after h2. they are of no use. 11) Use smaller and less images. 12) Make every page unique i.e. in terms of content and information. This is a very short list. there are many things which must be kept in mind to design and develop an ideal website.
talking about an ideal site........it must have a about us, sitemap, contact us,nice coding, good designing, robot.txt(if needed), 404 not found(if any page is deleted), privacy policy(very much important) and then everthing which is neccessary for ranking a website