Are you talking working on SEO in general or getting links. If you build up inbound links real fast and buy links just to inflate your PR, Google is going to see it and possibly ban your site. Or could your site just be experiencing Googles aging filter? How do you know it was banned?