I am curious that how these ranking checking tools work? Like googlerankings.com or anything like that, may be backlinkwatch and many more... Doesn't these tools send thousands of queries to search engines daily? Why dont they get blocked/banned? Anyone have some experience in creating such tools and can tell me how they work? I mean do they use proxy servers or what? any help would be appreciated. Thanks
Googlerankings.com ask for Your Googleâ„¢ SOAP API Key, so they use an api that allows up to 10k (I thought) requests a day, legally.
yes they do, and Google API allows 1k queries. OK, what about Yahoo, MSN and Ask.com? It doesn't use any API for them. And many many other tools don't ask for API as well. I was not asking specifically for googlerankings, just a general answer how these scripts work?
I think they just scrape pages. Search engines receive millions of requests a day, so they may not log all. Or maybe they just acquired some IP addresses across the globe.
Yup, she's a pure datascrape It would be best not to do it on your site though - build an external app that uses your own IP - not your Site's IP so your site isn't associated to the scraping ip (Or proxy it)