How are you checking your backlinks? Also, if your check them during an update, the numbers will be all over the place.
Their free Link Popularity Check? I have never used it. But for comparison purposes, try http://www.digitalpoint.com/tools/backlinks/
You can also use "link:http://www.yourdomain.com" (without the quotes) to do a back link check on Yahoo.