What you should do is make sure that you are building links through quality sources so that they do not disappear like they have with your case. If you link build between sites that you own or control the content on, this is perfect, because you can be sure that you backlinks will never disappear. Sometimes it takes Yahoo a long time to index your links also. Make sure you have given the robots time.