He said most would be held until the global war on terrorism is over - a fight that Rumsfeld has said could last years, if not decades.
The defense secretary said he expects some suspects to be tried before military tribunals but prefers that most continue to be imprisoned indefinitely.
"Our interest is in not trying them and letting them out," he said in a question-and-answer session after a speech to the National Press Club. "Our interest is in - during this global war on terror - keeping them off the streets, and so that's what's taking place."