We have a website built on LAMP stack and there will be a constant feed of newly created pages (sometimes 1000's) and content throughout the day What is the best way to tell Google to come and index this fresh content. I know that when I used wordpress, we would simply ping Google with the new post and it would come and index right away. Since these are not blog posts, what is the best way to get this content indexed ASAP? on a related note - for our sitemap, we are thinking about updating every few hours through CRON as it would seem unreasonable to rebuild on every new piece of content added.
You could also automate a ping to the site via cron and curl if you are running on a unix box. Google hourly via cron and curl in crontab add 0 * * * * curl "http://www.google.com/webmasters/sitemaps/ping?sitemap=[sitemap URL]" here is a link for info on Yahoo and MSN sitemap ping URLS
Currently there is no page level ping that I have found. We did create a page on our site to ping our three sites to the 4 main SEs. See http://www.catanich.com/sitemap-ping-services.asp for the format.
I read your article and you are saying that we should ping the sitemap no more than once a day? What about rolling out the fresh content in an RSS and pinging that Google Blog reader? Does it really matter if its not a "BLOG" as long as the RSS is same format- ie.. Hyperlinked title and short desc/
Submitting sitemap will be a very effective one.. most of the sites i am making have their sitemaps submitted manually but of course third party softwares will be very effective and time efficient.