What if some website's owner that you didn't know put a hidden anchored link of your website on their website will Google also penalize you? or just the one who put the anchored links on his website?
No, this would be unfair and penalise the wrong people. Only the site on which cloaked text is placed would suffer
Hidden text is a problem for the site it's on - why would you have something on your site you don't want people to see. And why on earth would anyone put a linkback to you and hide it like that.
Competitors that wants some revenge to you or wants to get your website penalize in Google SERP are the obvious reasons. Can Google detect it if that hidden link are purposely placed there to sabotage one's website? I mean like detecting IPs and something like that. Anyone?