QS is calculated at the keyword level. Actually, the ad-kw level. A low QS for a keyword in a group will not harm the others. It might be an indication that you should not have it in that group but it won't harm the others. Neither will a low search volume keyword.