Greens leader Richard Di Natale has called on Prime Minister Malcolm Turnbull to sack Immigration Minister Peter Dutton and to lead cultural change in Australia by ridding the Liberal Party of "rampant" sexism.

Senator Di Natale called Mr Dutton a "serial offender" who was "not able to deal with complex immigration issues" such as the case of Abyan, an asylum seeker allegedly raped on Nauru.

"Malcolm Turnbull needs to show he's serious about changing culture," Senator Di Natale said.

"One way he can do that is to ensure this repeat offender, Minister Dutton, is sent to the backbench where he belongs, and another suitable replacement is found for that difficult portfolio ... preferably a woman, a capable woman from within the Coalition ranks.

"He has made comments towards a senior journalist that do reflect the sexism that is at the heart of the Coalition government."

Mr Dutton is likely to avoid any further consequences for his text mishap, in which he labelled a journalist a "mad f---ing witch", which Mr Turnbull called "completely inappropriate".

Senator Di Natale said the Prime Minister should lead by example and bring about change in Australia's attitude towards women.

"What's required in this country is a change in culture. We need to see that change in culture come from the ground up, from our sporting institutions right through to politics," he said.

"I launched a domestic violence initiative on White Ribbon Day with the Prime Minister where he said very clearly that it was the responsibility of all men in Australia to call out sexism when they see it.

"That it was about men respecting their sisters, their mothers, their wives. And that where they fail to do it, they need to be called out.

"Well, the Prime Minister needs to demonstrate that he takes the issues seriously, that it's more than just rhetoric."

He also called on the government to reinstate domestic violence funding cuts and commended Liberal MP Sharman Stone for admonishing the "boys' club" in her own party.

Labor continues to call for an investigation into the leaking of a photograph of the public servant who complained about the behaviour of former cities minister Jamie Briggs.

"Actions speak louder than words and ... Mr Turnbull needs to show that he is taking this matter seriously by investigating who Mr Briggs sent this photograph to and who it was that gave it to The Australian newspaper so it could be published," shadow attorney-general Mark Dreyfus said on Wednesday.

The Prime Minister has rejected the calls, saying, "These leaks inquiries, they tend to come up with very little.

"I think we know the photograph was taken by Mr Briggs' phone and he shouldn't have done it."