Mr Giles has been under increasing pressure amid growing opposition calls for his sacking.

He is considering trying to deport about 30 people after an appeals tribunal allowed them to stay in Australia on the grounds of a directive he himself had signed off on.

Under Direction 99, Australia will “generally afford a higher level of tolerance” to non-citizens based on the length of their time spent in the country.

Mr Giles told ABC’s AM he had cancelled seven visas in the past few days.

Asked why he still had a job, he replied: “There’s so much work to do to clean up the mess, to rebuild the migration system that was left in tatters.”

Mr Giles said he would release the new ministerial directive for public scrutiny “as soon as its ready”.

“We believe these decisions need to be guided by two clear principles: the protection of the Australian community and by common sense,” he said.

“We want to strengthen the role of victims and the impact of them and their family members in consideration because that’s something we feel has been lacking, as well as, of course, ensuring the family violence consideration are consistent with the expectations of government and the wider Australian community.”

Earlier this week, Home Affairs secretary Stephanie Foster admitted her department breached protocol by failing to brief Mr Giles about legal decisions to allow foreign criminals to remain in the country.

A New Zealand man, known as CHCY, was allowed to keep his visa by the Administrative Appeals Tribunal despite being found guilty of raping his step-daughter.