Yeah. Some times quality less links disappeared like this. you need to build more quality and relevant links.
With what source you checked the backlinks? If its with Google operator then you should not worry about it as they only show some number of backlinks...