If google isnt giving out new API key's, and it is a violation of the TOS to screen scrape. How are the big SEO Tool Websites out there getting the google results? I love the digital point tool, but I've just recently passed a point where it doesnt update all my results when I check all, because of my google key limitation of 1000 I'm guessing. So if I write some screen scrape program to do this myself, and have 3000-4000 requests from my server each day hitting google, will they really care? And what happens when I grow to 30,000-40,000 per day? How is everyone else achieving this? I appreciate your ideas.
Most of the programs I have encountered, do a "human emulation" which basically scrapes the SERPs at a slower "human-like" speed so as not to get banned. This, of course, is a violation of TOS. But i dont see what Google expects everyone to do since they stopped distributing new APIs. I am kinda frustrated with it, to be honest.
Sure the api's still work, but we have a limit of 1000 per day, and a result limit of 10 right? So if I want to check the top 50 results for one set of keywords, I need to spend 5 queries. So what do you think is slow enough, for human emulation? 10 queries per minute? Wouldnt google think it is a corporate proxy server or some such?
Most sites ask users for their API key. If they don't have it, too bad too sad. But who cares, Yahoo and Google's results are very similar and Yahoo's API is free to use.
If I was just trying to get some results for the million other projects you can do with SERPs then yes, yahoo, or msn results would be fine. But if I'm writing an SEO script, to check to see if my site comes up in the top 50 of all three, then I need google. Especially when google controls more than 50% of the market share. It is imperative that you come up in google. My assumption is that all the big tools are doing screen scraping, and are violating google's TOS. Unless perhaps they have a custom search engine or appliance of some kind from google?
Nichebot for example asks users for their own API key. If you don't have one, you're out of luck, or stuck with Yahoo.
for all i know each of these has their different speculations ending to their own solutions through their equations but of course these things are not just "made up things" as what it may seem of course they made some research and observations about it...
Free SEO tools are available at following sites http://www.webmaster-toolkit.com/ http://seo.zunch.com/free_seo_tools.htm http://www.digitalpoint.com/tools/ http://www.globalpromoter.com/seo-tools/