Even if it is lower than your site it still adds up (just not as quickly as the higher PRs) Also if you can use link text with your keywords and the site is relavant then it might do more for you in the SERPs then a high PR site that is on a different subject.
If you aim is to increase you pagerank you need a lot of PR3 to be the equivalente of one single PR6 linking to you.