I guess it depends on who that person is, If its an American citizen its a right but its a member of Al Qaeda then its a privilege which we refuse to give them
Actually the United States Constitution states that it is indeed just a privilege, not a right. It is in article I. "The privilege of the Writ of Habeas Corpus shall not be suspended, unless when in Cases of Rebellion or Invasion the public Safety may require it."