Housing Minister Julie Collins will introduce legislation for the $10 billion Housing Australia Future Fund on Wednesday after the first ty at passing the bill was held up in the Senate.

The fund has been blocked by the coalition and Greens, with the minor party demanding an agreement from national cabinet for a rent freeze.

Prime Minister Anthony Albanese said he had spoken with Greens leader Adam Bandt at the weekend about the housing fund.

He said the Greens in a letter, wrote that they liked the housing fund being unresolved as they wanted to campaign over the issue.

“It’s a bizarre position which says you want people to be kept in poverty so that you can have a political campaign,” he told ABC radio.

Mr Albanese said the government couldn’t dismantle federation to pass the legislation and the issue of rent freezes was the jurisdiction of the states and territories.

The housing fund would deliver 30,000 social and affordable homes in its first five years, with 4000 for women and children at risk of domestic violence.

Should the bill be blocked a second time, the issue could be used as a trigger for a double dissolution, in which all of the Senate seats are up for election.

Ms Collins said there was an urgent need for the fund to pass as soon as possible.

“We cannot afford any delays to the Housing Australia Future Fund,” she said.

“This message has come from community housing providers, frontline homelessness services, state and territory housing ministers and tenants of social and affordable housing.

“The Greens and the Liberals should get out of the way and back this secure, ongoing pipeline of funding for social and affordable housing.”

The Greens and coalition had previously moved to delay debate in the Senate until October, after a national cabinet meeting between Mr Albanese and state and territory leaders.

Ms Collins said setbacks to implementing the fund had led to fewer social and affordable homes being built.

“Every day of delay is $1.3 million less that can be spent on housing Australians in need,” she said.

“We cannot afford any further delays.”

Greens senator Sarah Hanson-Young said the party would meet the government later this week for further negotiations on the bill and she was optimistic about the meeting.

“But, of course, the prime minister has to stop being so stubborn about this,” she told ABC TV.

“His threats over a double (dissolution), it’s a distraction, it is nonsense.

“Let’s just sit around the table and work out how we can help the third of Australians who he is currently ignoring, and that is those in the rental crisis.”