Hi, My site is http://mworld4m.com here i add a index.html (my custom maked html) please enter to understands And my forum is http://mworld4m.com/forum/index.php For that i am confused where to put sitemap.xml and what robots tag add for it Please help me.........
If you want only the links under forum to get indexed, have a sitemap under the "forum" directory where in the forum CMS has been installed or is custom built. If you trying to get all the URLs on the new site indexed add a sitemap.xml directly under the root domain. I mean right under your root domain domain.com/sitemap.xml
Personally I am using attracta to create my sitemap for me, and it then submits it to all the search engines. Maybe you can have a look at that as their tool is free to use.
Upload 3 version of sitemap at root folder of your main website. HTML, XML and TXT format, all 3 are important.
There are so many ways to do this. If you want to create a sitemap page and to show on your site as a navigation page, then one of the easy (which I prefer) way is - go to here http://wordpress.org/extend/plugins/wp-realtime-sitemap/ and download the "wp-realtime-sitemap" file; then unzip it and upload into you WP Plugin folder (under wp-content); then login into your site's wp-admin section and active this plugin under plugin section; also create a page for the sitemap navigation page and write down there [wp-realtime-sitemap] and publish it. If you want to create xml-sitemap for your website, then also there are lots of online sitemap generator by which you can make it. I prefer this one : http://www.xml-sitemaps.com/ just put your site there and generate your xml-sitemap; then download it and upload into the server directly (public html). Hope you will get your answer. Enjoy !!!
You have to add robot.txt to your public_html folder with this code inside: With the correct path to your sitemap of course! ps: remove the spaces between : //