Well I don't know if anyone has noticed this, but it always seems that PHPLD directories can index links alot quicker than Site-Sift Listings! I've noticed this from first hand experience, so I was looking through both types of directories, and it occured to me Site-Sift doesn't have a latest links page!? If Googlebot see's a regularly updated page, it will continuously go back to that page if the content is updated. So i'm guessing this is one of the main reasons for quicker indexing of detail pages, and category pages when using PHPLD. I have created a latest links page on LinksJuice.com, which basically displays the latest 100 links submitted and then links to detail pages. This is only in testing, I wanted to see if this actually makes Google index pages on Site-Sift quicker! I will post updates once I am able to see if its actually worked, and if it does I will be posting the mod free of charge on my blog. You can see the latest link page here, it's nothing special.. just seeing if it actually works! Thanks
I don't think just because you have a latest links page would make much difference to indexing. However a latest links page is a good idea for a directory. I would take the number down from a 100 links though.
It would, mainly because if it's got one page being updated daily. It'll know to go back to that page if it's updated every day, from there crawl the new detail pages etc. Because unless you have news feeds or something on your homepage.. it won't see any new data unless it crawls all through your site. Anyways, we will see if it works
How about adding Yahoo news via RSS to your category pages? The bot will see fresh content and may help in indexing those pages.
Please let us know how and BTW your site Rakcha is performing well at keywords. Thanks Terry for the info.
I am not using site-sift and I was redirecting the latest links page to the homepage. I will put a link back to it when I have time. it comes by default with the script I am using like in phpld. rakcha and enquira I am bulding them slowly and I am not expecting anything from them this year. the latest addition in enquira is 16 frequently updated blogs with original content, this will improve it a lot. It is only 1 month old you know.
Great post Terry, I'm sure now that you have added the latest links page you will see your directory getting crawled a lot more regularly.
I'm sure it makes a big difference when indexing pages. Most deeper categories are usually not crawled with the same frequency as a Latest Listings page linked from the root. Most of our listing details pages and new categories are indexed within a day or two of them appearing on the latest additions page.