I've spent all my time working with website design in the website development industry and no SEO at all. Well I recently launched my new website, developingbeyond.com and I don't think it's indexing since I've submitted a sitemap in google webmaster tools and no progress so far. Here's my sitemap; http://developingbeyond.com/sitemap.xml Here's my .htaccess; <Files .htaccess> order allow,deny deny from all </Files> Options All -Indexes Code (markup): My intention with the .htaccess was to disable directory listing. I honestly have no idea what options all - indexes lol... I found those codes with tutorials long time ago. I was the site to index and it doesn't look like it's working. I do not have a robots.txt, what could I do for that? What are the basic of robots.txt? I atleast want my website to be first when searched 'developing beyond'.
Hi, Website Tiger I think information from this site www.robotstxt.org would be really helpful for you. Generally speaking, robots.txt is the right place for blocking some decent robots from crawling some directories on your sites you don't want to be indexed. .htaccess file would usually be used for 301 redirection or transferring dynamic urls into static ones purpose. Have a nice day,
Thanks! That's quite helpful, how about the <meta> tags in html files, how do they work? Are they important, the one where you specify NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"? I know keywords and description are basically required but have no knowledge about the others.