Rowan County Clerk of Courts Kim Davis holds her hands in the air with her attorney Mat Staver and Republican presidential candidate Mike Huckabee in front of the Carter County Detention Center on September 8, 2015 in Grayson, Kentucky.
Rowan County Clerk of Courts Kim Davis holds her hands in the air with her attorney Mat Staver and Republican presidential candidate Mike Huckabee in front of the Carter County Detention Center on September 8, 2015 in Grayson, Kentucky.
PHOTO: Ty Wright/Getty Images North America/Getty Images
Now playing
02:43
Kentucky clerk released from jail
Kim Davis Republican Values Voter Summit award_00000606.jpg
Kim Davis Republican Values Voter Summit award_00000606.jpg
PHOTO: CNN
Now playing
01:24
Kim Davis receives award at Values Voter Summit
kim davis marriage kentucky clerk spencer pkg_00003005.jpg
kim davis marriage kentucky clerk spencer pkg_00003005.jpg
Now playing
01:26
Kim Davis: I'm just a normal person
PHOTO: CNN
Now playing
01:20
Clerk: Davis may have invalidated marriage license forms
same sex couple marriage license intvw rowan county kentucky_00003104.jpg
same sex couple marriage license intvw rowan county kentucky_00003104.jpg
Now playing
01:43
Gay couple applying for marriage license speaks to CNN
Kim Davis released jail_00001502.jpg
Kim Davis released jail_00001502.jpg
Now playing
01:12
Kim Davis and the fight over same-sex marriage
kentucky clerk kim davis released from jail savidge dnt erin _00013313.jpg
kentucky clerk kim davis released from jail savidge dnt erin _00013313.jpg
PHOTO: CNN
Now playing
01:57
Clerk who withheld same-sex licenses freed (2015)
Rowan County Clerk of Courts Kim Davis holds her hands in the air with her attorney Mat Staver and Republican presidential candidate Mike Huckabee in front of the Carter County Detention Center on September 8, 2015 in Grayson, Kentucky.
Rowan County Clerk of Courts Kim Davis holds her hands in the air with her attorney Mat Staver and Republican presidential candidate Mike Huckabee in front of the Carter County Detention Center on September 8, 2015 in Grayson, Kentucky.
PHOTO: Ty Wright/Getty Images North America/Getty Images
Now playing
02:43
Kentucky clerk released from jail
kim davis release sot_00011510.jpg
kim davis release sot_00011510.jpg
Now playing
01:59
Kim Davis reacts to her release
Republican presidential candidate and former governor of Arkansas Mike Huckabee speaks during the Iowa Faith and Freedom Coalition annual banquet and presidential forum  Monday June 22, 2015 in Des Moines, Iowa.
(Taylor Glascock for CNN)
Republican presidential candidate and former governor of Arkansas Mike Huckabee speaks during the Iowa Faith and Freedom Coalition annual banquet and presidential forum Monday June 22, 2015 in Des Moines, Iowa. (Taylor Glascock for CNN)
PHOTO: Taylor Glascock for CNN
Now playing
02:40
Gov. Mike Huckabee speaks after Kim Davis' release
Kim Davis released jail_00001502.jpg
Kim Davis released jail_00001502.jpg
Now playing
07:35
Kim Davis' attorney: She won't violate her conscience
kentucky clerk marriage licenses huckabee intv lead_00001219.jpg
kentucky clerk marriage licenses huckabee intv lead_00001219.jpg
Now playing
02:38
Huckabee defends clerk's actions on marriage licenses
kim davis marriage license contempt hearing ATH_00011020.jpg
kim davis marriage license contempt hearing ATH_00011020.jpg
PHOTO: Getty Images
Now playing
01:26
Santorum: Kim Davis is heroic
first same sex couple marriage license rowan county newsroom_00000521.jpg
first same sex couple marriage license rowan county newsroom_00000521.jpg
PHOTO: CNN
Now playing
01:13
Same-sex couple gets marriage license from Kim Davis' office
heated confrontation clerk denying marriage licenses kentucky pkg_00003430.jpg
heated confrontation clerk denying marriage licenses kentucky pkg_00003430.jpg
PHOTO: WKYT
Now playing
00:58
Heated confrontation with clerk denying marriage licenses
kentucky gay marriage clerk counsel lead intv_00020630.jpg
kentucky gay marriage clerk counsel lead intv_00020630.jpg
Now playing
03:18
Counsel: Ky. clerk wants her name off marriage license
kentucky clerk kim davis appeal dnt casarez lead_00000307.jpg
kentucky clerk kim davis appeal dnt casarez lead_00000307.jpg
PHOTO: WKYT
Now playing
02:12
Supporters gather in solidarity for Kentucky clerk
Clerk defies Supreme Court marriage licenses sot_00005601.jpg
Clerk defies Supreme Court marriage licenses sot_00005601.jpg
PHOTO: WLEX
Now playing
01:28
Clerk denies marriage licenses on 'God's authority'
Rowan County, Kentucky, clerk Kim Davis was given a second chance: She didn
Rowan County, Kentucky, clerk Kim Davis was given a second chance: She didn't have to issue same-sex marriage licenses herself; she merely had to agree not to interfere with five deputy clerks who had told the federal judge they'd issue them in her stead.
PHOTO: Carter County Prison
Now playing
02:52
Same-sex marriage showdown in Kentucky

Story highlights

NEW: "I just want to give God the glory," Kim Davis tells supporters after her release

Order says Davis can't interfere with issuing marriage licenses to legally eligible couples

Deputy clerks began issuing marriage licenses to same-sex couples after Davis was jailed

(CNN) —  

Kim Davis broke down in tears, then beamed as she stood before a cheering crowd after her release from jail Tuesday.

The Kentucky clerk, who was held in contempt of court for refusing to issue same-sex marriage licenses, urged her supporters not to give in.

“Thank you all so much. I love you all so very much,” she said. “I just want to give God the glory. His people have rallied, and you are a strong people. We serve a living God who knows exactly where each and every one of us is at. Just keep on pressing. Don’t let down, because he is here. He’s worthy.”

Davis, who said issuing the licenses would violate her conscience and go against her religion, plans to return to work in Rowan County, Kentucky, this week and won’t resign from her post, attorney Mat Staver said. Asked by a reporter whether her stay in jail was worth it, Davis smiled and nodded.

But she didn’t speak directly about the case, and a key question remains unanswered: When she goes back to work, what will she do when she gets there?

The judge who issued an order releasing her Tuesday attached a caveat Davis may not be willing to accept.

U.S. District Judge David Bunning ordered that Davis be released from jail – five days after he sent her there – saying he was satisfied that her deputies fulfilled their obligations to give marriage licenses to same-sex couples in her absence.

Ted Cruz: ‘Praise God that Kim Davis is being released’

But Bunning’s new order says Davis cannot interfere with her deputies issuing marriage licenses to all legally eligible couples.

That means Davis could find herself behind bars again if she does anything to prevent the marriages from taking place, CNN Senior Legal Analyst Jeffrey Toobin said.

“If Ms. Davis stops them from issuing licenses, then we are right back where we started,” Toobin said. “And Judge Bunning has made it quite clear, he will lock her back up.”

’She’s not going to violate her conscience’

Davis previously said she will not authorize her office to issue marriage licenses to same-sex couples unless the state removes the authority of her office from the forms.

Read the judge’s order

One of Davis’ attorneys said the judge hasn’t resolved anything.

“We’ve asked for a simple solution – get her name and authority off the certificate. The judge could order that,” Staver said.

Staver didn’t directly answer questions about whether Davis would stop same-sex couples in her county from getting marriage licenses when she returns to work.

“She loves God, she loves people, she loves her work and she will not betray any of those three,” Staver said. “She’ll do her job good. She’ll serve the people … and she’ll also be loyal to God, and she’s not going to violate her conscience.”

Bunning ordered Davis to jail on Thursday after finding her in contempt of court for refusing to issue marriage licenses to gay couples in Rowan County after June’s U.S. Supreme Court ruling legalizing same-sex marriage.

ACLU: ‘Goal has been achieved’

After Bunning’s order, five of her deputies agreed to issue marriage licenses in her absence. The Rowan County clerk’s office began doing so Friday.

A lawyer who represented same-sex couples seeking marriage licenses in Rowan County said Tuesday that the plaintiffs’ goal had “been achieved.”

“This case was brought to ensure that all residents of Rowan County, gay and straight, could obtain marriage licenses. That goal has been achieved,” said William Sharp, legal director of the American Civil Liberties Union of Kentucky. “The Kentucky Attorney General and counsel for Rowan County have said the marriage licenses are valid. We are relying on those representations, and our clients look forward to proceeding with their plans to marry.”

At rally, Republican presidential hopeful takes center stage

The case has become a political lightning rod, drawing attention from several Republican presidential hopefuls, even though Davis is a Democrat.

At Tuesday’s rally, Davis was flanked by her attorney and her husband, but former Arkansas Gov. Mike Huckabee emceed her theatrical arrival at the event, introducing her to cheering crowds as the song “Eye of the Tiger” blared.

Huckabee said he had a message for the judge who sent Davis to jail last week and ordered her release Tuesday.

“If you have to put someone in jail, I volunteer to go. Let me go. Lock me up if you think that’s how freedom is best served,” Huckabee said. “Because folks, I am willing to spend the next eight years in the White House leading in this country. But I want you to know I’m willing to spend the next eight years in jail, but I’m not willing to spend the next years in tyranny under people who think they can take our freedom and conscience away.”

Texas Sen. Ted Cruz also traveled to Kentucky to meet with Davis, but he was not part of the pro-Davis rally that appeared on live cable television.

Attorneys: State religious freedom law supports Davis

Davis’ legal team has filed appeals to the 6th U.S. Circuit Court of Appeals.

“If (Davis’ deputies) can issue licenses under someone else’s authority … Kim Davis would not stand in the way of that,” another attorney, Roger Gannam, told CNN’s “New Day” on Tuesday.

Davis’ legal team on Monday asked the appeals court for an injunction that would prompt Kentucky Gov. Steve Beshear to remove her office’s authority from the licenses, something her attorneys say Beshear can do through an executive order.

Some of Davis’ opponents say she could resign if she feels she can’t issue licenses to same-sex couples.

But Davis should not have to resign or be jailed, Gannam said, because “accommodation of religious conscience is the law in Kentucky, including for elected officials.”

Who is Kim Davis?

Gannam cited Kentucky’s Religious Freedom Restoration Act. The 2013 law prohibits the state government from substantially burdening a person’s freedom of religion unless the government both proves it has a compelling interest in doing so and has used the least restrictive means to do it.

“It’s the duty of the Kentucky government to accommodate that, and they very easily could do so,” Gannam said. “Gov. Beshear is the one who should do his job or resign.”

Chris Christie: Kentucky clerk Kim Davis should have been placed in other job

Governor: No special session

Kentucky Gov. Steve Beshear’s office said Monday he won’t respond, noting that the conflict was a “matter between her and the courts.”

The state Legislature also could pass a law removing clerks’ names from the licenses, but it won’t be in session until January.

Beshear said the Legislature can do as it wishes, but he won’t call lawmakers for a special session, adding that doing so would cost “hundreds of thousands of dollars of taxpayers’ money.”

Kim Davis has been divorced three times

Opinion: Was it right to jail her?

CNN’s Alexandra Field, Kristina Sgueglia, Steve Almasy, Tony Marco, Tom LoBianco, Tal Kopan and Theodore Schleifer contributed to this report.