Maybe not all the links, but certainly most of the links should be from very relevant pages. The relevant links will give you a lot more link juice and make your link profile look natural. If most of your links come from totally unrelated sites you'll probably run afoul of Google sooner or later.