Log in or Sign up

NEW - Autodiscovery of Sitemaps using robots.txt

Discussion in 'Search Engine Optimization' started by Claudek, Apr 11, 2007.

Claudek Well-Known Member

Messages:

1,379

Likes Received:

81

Best Answers:

0

Trophy Points:

165

#1

This is good news for all webmasters.
Yahoo has just announced this on their blog - http://www.ysearchblog.com/archives/000437.html/

All search crawlers recognize robots.txt, so it seemed like a good idea to use that mechanism to allow webmasters to share their Sitemaps. You agreed and encouraged us to allow robots.txt discovery of Sitemaps on our suggestion board. We took the idea to Google and Microsoft and are happy to announce today that you can now find your sitemaps in a uniform way across all participating engines. To do this, simply add the following line to your robots.txt file:

Sitemap: http://www.example.com/sitemap.xml

Please provide the complete URL for your Sitemap on this line. We will pick it up wherever you put it in your robots.txt file. This directive is not specific to user-agent. If you have multiple Sitemaps, you can point to your Sitemap index file on this line.
Click to expand...

Claudek, Apr 11, 2007 IP

(You must log in or sign up to reply here.)