WASHINGTON (CNN) -- Embattled World Bank President Paul Wolfowitz and the White House were in talks Wednesday afternoon with World Bank officials to work out details of his resignation, senior administration officials told CNN.

Under a proposed agreement, Wolfowitz would leave voluntarily but the World Bank would admit some culpability in the handling of his girlfriend's transfer to a State Department job, along with a hefty pay increase.

Administration officials told CNN that they expect Wolfowitz to leave "soon," if not today.

Reached at his office Wolfowitz's lawyer, Bob Bennett, said it would be "premature" to say Wolfowitz is about to leave, but would not comment any further. In the past, Bennett has said that Wolfowitz would not resign "under a cloud."

The White House has concluded that Wolfowitz cannot serve anymore, administration sources familiar with the discussions told CNN's Ed Henry.

One holdup has been resistance by Vice President Dick Cheney, who continues to support the World Bank president. But the sources said support for Wolfowitz is dropping at the White House and many in the administration don't think he can recover from this ongoing scandal.

Wolfowitz was supposed to travel to Slovenia Wednesday night on World Bank business but a World Bank official told CNN that the trip is on hold.