US House Majority Leader, Representative Kevin McCarthy,R-CA, speaks following the weekly House Republican Conference meeting at the US Capitol in Washington, DC, October 7, 2015.
SAUL LOEB/AFP/AFP/Getty Images
US House Majority Leader, Representative Kevin McCarthy,R-CA, speaks following the weekly House Republican Conference meeting at the US Capitol in Washington, DC, October 7, 2015.
Now playing
02:10
Kevin McCarthy quits speaker race; vote postponed
Congressman (R-NC-3rd District); Armed Services Committee
CNN
Congressman (R-NC-3rd District); Armed Services Committee
Now playing
01:46
Congressman warns of 'skeletons in closets'
Pool
Now playing
01:47
Pressure building for Paul Ryan to run
US House Majority Leader, Representative Kevin McCarthy,R-CA, speaks following the weekly House Republican Conference meeting at the US Capitol in Washington, DC, October 7, 2015.  AFP PHOTO /  SAUL LOEB        (Photo credit should read SAUL LOEB/AFP/Getty Images)
SAUL LOEB/AFP/Getty Images
US House Majority Leader, Representative Kevin McCarthy,R-CA, speaks following the weekly House Republican Conference meeting at the US Capitol in Washington, DC, October 7, 2015. AFP PHOTO / SAUL LOEB (Photo credit should read SAUL LOEB/AFP/Getty Images)
Now playing
01:01
Kevin McCarthy drops out of speaker race
McCarthy Benghazi committee comments Fox_00003110.jpg
Fox News Channel
McCarthy Benghazi committee comments Fox_00003110.jpg
Now playing
00:52
Kevin McCarthy clarifies Benghazi comments
Now playing
03:32
Jason Chaffetz challenges Kevin McCarthy for House speaker
House Majority Leader Kevin McCarthy (R-CA) speaks during a press conference following the weekly House Republican conference meeting at the U.S. Capitol February 25, 2015 in Washington, DC.
Win McNamee/Getty Images North America/Getty Images
House Majority Leader Kevin McCarthy (R-CA) speaks during a press conference following the weekly House Republican conference meeting at the U.S. Capitol February 25, 2015 in Washington, DC.
Now playing
01:31
Timeline of the McCarthy Benghazi committee slip-up
U.S House Majority Leader Rep. Kevin McCarthy (R-CA) (L) listens as Speaker of the House Rep. John Boehner (R-OH) (R) speaks to member of the media after a House Republican Conference meeting September 29, 2015 at the U.S. Capitol in Washington, D.C.
Alex Wong/Getty Images North America/Getty Images
U.S House Majority Leader Rep. Kevin McCarthy (R-CA) (L) listens as Speaker of the House Rep. John Boehner (R-OH) (R) speaks to member of the media after a House Republican Conference meeting September 29, 2015 at the U.S. Capitol in Washington, D.C.
Now playing
00:48
House Republicans repudiate McCarthy comments on Benghazi probe
kevin mccarthy house speaker race lead full intv_00003918.jpg
kevin mccarthy house speaker race lead full intv_00003918.jpg
Now playing
07:06
More vetoes, more hearings: McCarthy outlines new strategy
Now playing
01:45
Chaffetz: Kevin McCarthy's Benghazi comments 'inappropriate'
jason chaffetz house speaker no expect win lemon intv ctn_00002718.jpg
CNN
jason chaffetz house speaker no expect win lemon intv ctn_00002718.jpg
Now playing
01:14
Chaffetz: McCarthy has the majority of support
Democratic Presidential candidate Hillary Clinton speaks at a Reception for New Hampshire Organized Labor Community and Allies event September 5, 2015 in Manchester, New Hampshire.
Darren McCollester/Getty Images North America/Getty Images
Democratic Presidential candidate Hillary Clinton speaks at a Reception for New Hampshire Organized Labor Community and Allies event September 5, 2015 in Manchester, New Hampshire.
Now playing
01:41
Clinton: Kevin McCarthy's comments 'deeply distressing'
U.S House Majority Leader Rep. Kevin McCarthy (R-CA) (L) listens as Speaker of the House Rep. John Boehner (R-OH) (R) speaks to member of the media after a House Republican Conference meeting September 29, 2015 at the U.S. Capitol in Washington, D.C.
Alex Wong/Getty Images North America/Getty Images
U.S House Majority Leader Rep. Kevin McCarthy (R-CA) (L) listens as Speaker of the House Rep. John Boehner (R-OH) (R) speaks to member of the media after a House Republican Conference meeting September 29, 2015 at the U.S. Capitol in Washington, D.C.
Now playing
04:27
Rep. McCarthy: 'I want to fight to win'
####2014-06-20 00:00:00 Shot 06/20/2014.## NS Slug: FAITH & FREEDOM:REP MCCARTHY WALKUP    Video Shows: Newly elected Majority Leader Rep Kevin McCarthy walks up to podium      Keywords:   ##
POOL
####2014-06-20 00:00:00 Shot 06/20/2014.## NS Slug: FAITH & FREEDOM:REP MCCARTHY WALKUP Video Shows: Newly elected Majority Leader Rep Kevin McCarthy walks up to podium Keywords: ##
Now playing
01:17
The rise of Rep. Kevin McCarthy
House Majority Leader Kevin McCarthy, R-CA, speaks during an event to urge US President Barack Obama to sign the  Keystone XL legislation on February 11, 2015 in the Rayburn Room of the US Capitol in Washington, DC.
MANDEL NGAN/AFP/AFP/Getty Images
House Majority Leader Kevin McCarthy, R-CA, speaks during an event to urge US President Barack Obama to sign the Keystone XL legislation on February 11, 2015 in the Rayburn Room of the US Capitol in Washington, DC.
Now playing
01:17
Kevin McCarthy announces run for House speaker

Story highlights

Republicans were shocked by McCarthy's decision to withdraw from the race

McCarthy: 'I'm not the guy'

(CNN) —  

Republican lawmakers were still filtering into the ornate House Ways and Means Committee room and digging into a lunch of barbeque chicken, beef and pork tacos from a local food truck – completely unaware of the bombshell that was about to drop.

As Kevin McCarthy got up to speak, there were audio problems with his microphone and some Republicans in the room couldn’t hear him when he began talking.

He didn’t directly announce he was withdrawing from the race, but McCarthy began talking about the need for House GOP members to figure out a way to unite.

The room went silent when they realized where he was going and members sat stunned when he ended his remarks saying, “I’m not the guy.”

READ: House meltdown: agony and ecstasy for 2016 contenders

This account of one of the most dramatic days in the recent history of the House is based on interviews with dozens of lawmakers who witnessed McCarthy abandon his campaign for the speakership. His decision leaves the chamber adrift at a time when it faces crucial decisions in the coming months on whether the government will default on its debt or shut down entirely.

The day began with a tense meeting in the basement of the Capitol.

McCarthy was making his case when one of his colleagues took him to task for comments suggesting that the Benghazi oversight committee was aimed at hurting Hillary Clinton politically.

“It was a verbal blunder, and how can we have someone who made such a blunder and immediately make him our leader?” Rep. Dana Rohrabacher growled at McCarthy.

McCarthy apologized, but insisted he was “moving forward,” attendees said.

The California Republican knew he could prevail in the midday House GOP conference election. But he was far more worried about the long slog until Oct. 29, when the full House would have to approve his nomination. That would require significant arm twisting – and a number of more junior Republicans in conservative districts would have to take tough votes to preserve his chances at the speakership.

READ: House meltdown: agony and ecstasy for 2016 contenders

It was clear McCarthy was sensitive to that concern. Moreover, he had grown angry at a group of rabble-rousing conservatives in the House Freedom Caucus. He methodically courted and promised to work with them. He spoke to the conservative caucus Tuesday night and, by all accounts, he gave an effective presentation.

But the bloc still threatened to undermine his candidacy when it came for a vote on the House floor, people close to him said. He sensed he wouldn’t be able to win them over unless he gave into a growing list of demands.

“I don’t know what he could do,” said Rep. Thomas Massie, R-Kentucky, when asked what moves McCarthy could make to win over the hard-right of his conference.

After the two-hour morning candidate forum Thursday morning, several of the younger House Republicans came to McCarthy and told him they supported him, but they were bracing for a firestorm when they went home for a week-long recess next week. They said there was growing pressure from outside groups against elevating someone who the right viewed as another John Boehner.

McCarthy recognized that if this much blowback was brewing now, it would only ramp up in the upcoming debate he would need to navigate on the debt ceiling, which needs to be raised by Nov. 5.

He made a decision he didn’t want to put his party through more drama, and he wasn’t going to be able to unite the bitterly divided GOP conference.

READ: Donald Trump takes credit for Kevin McCarthy dropping out

“Numbers, pure and simple. He had the votes to win the conference vote, but there just wasn’t a path to 218,” a source close to McCarthy.

McCarthy kept the matter mostly to himself, but told a handful of his closest allies ahead of time. He didn’t tell Boehner until minutes before the meeting to elect the new speaker was about to start.

Since Conference Chair Cathy McMorris Rodgers was chairing the election, McCarthy also huddled with her briefly minutes before his announcement to tell her there was no need to hand out ballots: He was dropping out.