Google monitors clicks from the SERPs , so they know which sites are clicked. And many webmasters use Google Analytics.
I think that they have some database or smt. and they can track positions, clicks... Just think...they know the age of a domain name, ip migrations and so on.