Google is not issuing SOAP API keys from December 2006. Now is there any other API available by Google for counting back links and indexed pages?
Hey, I think I am genius. My questions are very difficult to answer. This is my second post on DP without any answers.
You can right your own API by requesting google.com from your custom application if you really need to know such info.
Are we allowed to crawl the google search results for a given term and output this info? isn't that scraping information, and is it allowed? can someone please clarify?
It IS allowed, it just needs to be shared by others and/or seen as a user resource. I believe that you could make something far better for all of this. What about backlink counts with the web hosts shown (the hosting company site's IP address for the site linking to your site) on a Google map as well as mashed together with a backlink analyzer universally added to by all the different SEs? What's up with MSN? Why don't they ever show many links indexed for your site? They're really pretty horrible at the crawling action.
I recently wrote a Java app which will find out what Google search results page your site is listed on for a certain keyword(s). For example, I did a search for digitalpoint.com for keyword "adsense" and the app tells me the site is listed on results page 2. Is very handy... Send me a PM if you are interested and ill send it over.
I think many of the SEO tools use the API function, instead of scrapping. I could be wrong but G' does not like scrapping.
Web scraping generically describes any of various means to extract content from a website over HTTP for the purpose of transforming that content into another format suitable for use in another context. source: http://en.wikipedia.org/wiki/Web_scraping
Anyone know of any Dashboard Widgets (Mac) for backlink analysis? I would love to be able to quickly analyze my sites each morning with API widgets...Thanks!
Is there an answer to the original question in this thread? Seems like it is: there must be and/or roll your own.
I don't think there is any other way right now than scraping. However if you do too many queries, google will ban your ip and tell you that you are using some sort of robot tool for extracting information (which is not allowed). I made 2 apps earlier, one which found out for a particular keyword, where did a site ranked, and second one for getting backlinks. For the first one, i had google ban my ip address after doing 50 queries in a row. Took a while before ip was unbanned.
Not to sound odd, but would you mind sharing how you made the app ? Does it get the results via scraping ? Or any other method is present ?
It was a bit of a bodge job because it was my first time writing anything like this but it works perfectly. It basically searches through the source code of the results page.. Plus a few little tricks I picked up. Ive just sent you a PM with the download URL.
Any pointers / examples ? What i want to find out is the backlinks and indexed pages count, does the api allow that ?
I posted this question 5 months ago after searching Google. I did not find anything useful. Can you help us in this regard. Thankjs