My sitemap is showing up in the Google Search instead of the actually page. My deep page names are the actually keywords example DomainName/these-are-my-keywords-and-name-of-the-page.html So in my sitmap it has those words for that particular page so if someone would google "These are my keywords and name of the page" the sitemap itself is showing up in Google and will sometimes have the Actual page under that sitemap search result(with the indent in). Is there a way to have Google Crawl the sitemap but not actually index it? Or is there something else that can be done? Thanks
Put this as the last line of your robots.txt file Sitemap: http://www.example.com/sitemap-name.xml or Sitemap: http://www.example.com/sitemap-name.xml.gz (in case your sitemap is gzipped) including the [Sitemap :] (without backets, I dont know how to post it correctly here since DP automatically put links to the url)
if you put robots txt on site map[/URL], it will not be able to crawl deep links. Its not good practice. If results appear for site map, its good. There is no reason to get worried over. Regards Munaz SumTotal Systems, Inc
Add this to the sitemap page: <meta name="ROBOTS" content="NOINDEX"> This will let crawlers follow the links from the sitemap page but prevent it from being indexed and showing up in search results.