vpguy
Nov 14th 2007, 3:48 pm
Is there a secret to getting Yahoo to "come back" and crawl my site again?
Here's the situation: when I launched my site 3 months ago, I had many pages in the root folder. Shortly after Yahoo crawled my site and indexed everything, I restructured my folder hierarchy and moved all those pages into a subfolder, but I did it (what I thought was) "the right way" - I copied the pages to their new location, updated my internal links and sitemaps, set up 301 redirects to point the old addresses to the new addresses, and disallowed access to the old addresses in robots.txt. This should have theoretically eliminated all access/visibility to these pages from good robots like Yahoo's.
Google completely cleaned up its index by removing the old and indexing the new, but Yahoo is still showing the old pages without removing them from their index.
Is there any way to get them to wake up and smell the coffee? There are too many pages (about 100) to use the "Remove URL" feature in their Site Explorer (which doesn't work anyway due to a CSS problem that prevents you from clicking the Yes button, but that's another topic for another day).
If I delete the sitemap from Site Explorer, wait a few days and add it back, will that do the trick?
Here's the situation: when I launched my site 3 months ago, I had many pages in the root folder. Shortly after Yahoo crawled my site and indexed everything, I restructured my folder hierarchy and moved all those pages into a subfolder, but I did it (what I thought was) "the right way" - I copied the pages to their new location, updated my internal links and sitemaps, set up 301 redirects to point the old addresses to the new addresses, and disallowed access to the old addresses in robots.txt. This should have theoretically eliminated all access/visibility to these pages from good robots like Yahoo's.
Google completely cleaned up its index by removing the old and indexing the new, but Yahoo is still showing the old pages without removing them from their index.
Is there any way to get them to wake up and smell the coffee? There are too many pages (about 100) to use the "Remove URL" feature in their Site Explorer (which doesn't work anyway due to a CSS problem that prevents you from clicking the Yes button, but that's another topic for another day).
If I delete the sitemap from Site Explorer, wait a few days and add it back, will that do the trick?