WASHINGTON (CNN) -- The House GOP leadership backed Rep. Mark Foley's decision to resign after his e-mails to a congressional page surfaced, while promising action to ensure the safety of all Capitol Hill pages.

"He's done the right thing," said Speaker Dennis Hastert, R-Illinois, adding. "None of us are very happy about it."

Hastert explained that Foley sent a letter of resignation for Florida Gov. Jeb Bush, a copy of which was obtained by the congressional leadership. The speaker said he has asked Rep. John Shimkus, R-Illinois, the head of the page board, to look into the issue.

Majority Whip Roy Blunt echoed Hastert, saying, "It sounds ... to me that Mark made the right decision to leave the Congress."

Calling Foley a "friend" and "hard-working member of Congress," the Missouri Republican said, "I'm concerned that Mark is able to deal with this problem in the way he needs to deal with it.

"I'm particularly concerned about any pages who may have been involved," he added.