(CNN) -- The president of the National Association of Evangelicals resigned Thursday after denying an accusation by a male prostitute that the pastor paid him for sex over three years.

The Rev. Ted Haggard said he is also temporarily stepping aside from the pulpit of his church in Colorado Springs, Colorado, pending an internal investigation by the church. The National Association of Evangelicals is an umbrella group for more than 45,000 churches and some 30 million members across the country.

"I've never had a gay relationship with anybody. I'm steady with my wife. I'm faithful to my wife," Haggard told CNN affiliate KUSA-TV.

Haggard is married and has five children, according to the National Association of Evangelicals Web site. Colorado is one of eight states where voters will consider bans on same-sex marriage in Tuesday's elections, and Haggard has been a supporter of the measure.

Full story