I'm wondering if the quality of your traffic has any effect on rankings. In other words, does google know the difference between a site where most visitors stay for more than five minutes one where most visitors quickly leave?
google track who has clicked for which keywords. i think every click to your site is vote for having a better serp
Google doesn't know who has visited your site unless they reached you via their engine, or you are telling them somehow (i.e. adsense). If someone clicks on a static link on Site A to reach you, how would they know unless they had access to that site or yours?