The centre's legal advocacy director Daniel Webb said the government was bulldozing the Manus detention centre but the men inside had nowhere to go.
The move comes exactly three weeks before its closure, which was declared unlawful by PNG's highest court in April last year, and follows two recent deaths and a spate of violent attacks against refugees held on the island.
Behrouz Boochani, an Iranian journalist held on Manus, said people were really frustrated and disappointed by this news.
He said after four years of pain the Australian government should transfer them to a safe place, not to another hell.
Mr Webb is asking the government to bring people being warehoused on Manus and Nauru to Australia.
Photo: supplied Detainees on Manus Island