Skip to main content

Obamacare fix: upgrades, 24/7 trouble-shooting, and old pizza

By Z. Byron Wolf, CNN
updated 11:38 AM EST, Sat November 30, 2013
  • Two-month race to fix site hits major deadline Saturday
  • "War room" mentality takes over as contractors work with administration
  • "Ruthless prioritization" to get site working quickly may have a consequence

(CNN) -- Saturday marks the Obama administration's self-imposed deadline to fix the troubled website, for most people at least.

Deadline Day: Will Obamacare website work?

It caps a frenzied, two-month race by computer programmers and contractors sprinkled throughout the D.C. suburbs on both sides of the beltway in Maryland and Virginia.

The overall scene in response to the botched rollout of the online portal conveys a "war-room" urgency with "ruthless prioritization," many moving parts, grinding work, briefings, phone-bridges, and of course, plenty of take-out food.

Operations are overseen from a command center in Columbia, Maryland. That's where contractor QSSI has spearheaded the effort with help from some Web heavyweights.

John Engates, the Chief Technology Officer at, was an early critic of the website given a behind-the-scenes tour of the effort to fix it.

"I think it's going to work," Engates said on CNN's "The Lead."

Obamacare deadline
Insurers fear more Obamacare trouble
Obamacare small business exchange delay
Obamacare delayed for small businesses

But Luke Chung, president of Virginia-based software developer FMS Inc., called the administration's prediction the site would work at 80% capacity on or around November 30 an impractical threshold in the software world.

The site, which was taken down for overnight maintenance ahead of Saturday's deadline, is the lynchpin of Obamacare and is meant to be used by 36 states to enroll millions of Americans into health insurance now required by federal law.

Fourteen states have their own exchange sites and those, by and large, have fared better than, which was marred by crashes and other problems upon its launch October 1, embarrassing President Barack Obama, who championed the law known as Obamacare.

What happened in October?

The first thing to figure out was what went wrong -- in brief.

"Not all websites are created equal," Steven Van Roekel, the nation's chief information officer and a former personal assistant to Bill Gates who helped roll out Windows XP, told reporters on Tuesday at a White House briefing.

Unlike a site like, which he said is only to be viewed, or even an e-commerce site, which takes orders, is meant to be seamlessly multi-faceted.

A single user's experience, unbeknownst to them, could require real-time information from the social security administration, DHS, the IRS and Veterans Affairs.

Fixing it on Obama's orders was ultimately left to Jeffrey Zients, the management consultant and entrepreneur and former and future White House official.

He assembled a team, which includes Van Roekel and other experts, to oversee the overhaul being done by QSSI, other contractors and programmers.

High intensity approach

Zients conducted Tuesday's White House briefing for reporters at a clipped pace and with the no nonsense tone of a tour guide in a hurry.

The session included a teleconference with the team from QSSI in Maryland -- they couldn't spare the time to make the trip into Washington -- and programmers who drove into town from Tyson's Corner in Virginia, where most of the software work is being done.

Boehner signs up for Obamacare
One side of Obamacare, failure
One side of Obamacare, success
Where's the anonymous shopping perk?

Seeking to confound the public view of the site as an epic failure of Presidential management, Zients and the contractors described a hive of trouble-shooters huddled at twice-daily conference calls and on a round-the-clock open phone line to respond as quickly as possible to problems.

"The point of these calls is we don't have an hour or a minute to waste and therefore, we need to make sure that there is ruthless prioritization at all times as to what matters most, that there's real-time reaction if something unexpected happened, someone hit a roadblock on a fix -- so what are we going to do about that bug and how are we going to address that bug, and you get the best minds on the problems right away," said Zients.

At a satellite office of QSSI in Virginia, insiders described to CNN's Brianna Keilar a scene of programmers in marathon code-writing sessions and surrounded by stale Chinese food and half-eaten pizzas.

Back-end concern

One result of Zients' prioritization? A focus over the past two months on the experience for users who want to sign up for insurance. That approach could have a consequence.

Insurers have reported receiving duplicative and at times faulty information on the back end of the site, which raises questions about whether some people who think they're signing up for insurance will actually have it on January 1.

Insurers: Site glitches persist

Indeed, much of the system supporting - the back end for making payments and interacting with insurance companies -- still needs to be built.

But so far, it has been the difficulty for Americans trying to sign up for coverage in the first place that has partly damaged public perception of the law.

Obamacare site fix: 5 things to look for

So the programmers and the contractors pay constant attention to real-time site metrics provided by services like Chartbeat, which is used to measure exactly how many people are on the site at any given time.

A quickly flashed screen grab during the technical briefing at the White House showed there were 15,687 users on at one point. The aim is to have the site capable of hosting 50,000 at any given time and up to 800,000 per day.

That was the goal for the site back on October 1 when repeated crashes seemed to keep most everyone trying to access the site from viewing insurance options.

After hardware upgrades installed November 23 and 24 to improve capacity and after software programmers spent the past two months addressing other hiccups, supporters of the law hope the website will function as intended.

Awash in metrics

They are awash in detailed metrics at the Maryland command center. In addition to Chartbeat, another web-based program measures response times; a spike on the graph can indicate serious problems. A third measures how far each and every user makes it through the enrollment process.

Don't look for any of that data after the deadline this weekend, however. Specifics are still closely guarded details.

"We will continue to update you on metrics and user experience and our success rates as we go forward," said Zients.

CNN/ORC Poll: Are Obamacare's flaws fixable?

Boehner signs up for Obamacare

GOP Obamacare playbook: Spread negative perception

Site's Anonymous Shopper shelved

Part of complete coverage on
updated 6:41 PM EDT, Tue October 29, 2013
Nationally, consumers are learning a number of well-known hospitals won't accept insurance under Obamacare.
updated 1:16 PM EST, Mon December 23, 2013
Open enrollment started October 1. Here's a step-by-step guide to navigating the insurance marketplaces, also known as exchanges.
updated 10:27 AM EDT, Tue October 22, 2013
A host of issues have plagued the highly anticipated launch, making it difficult for both consumers and insurance providers.
updated 4:37 AM EDT, Sat October 19, 2013
Obamacare has survived a Supreme Court appeal, a government shutdown and ongoing challenges by opposing politicians. With few exceptions, every American must have health insurance by March 31 or pay a penalty fee.
updated 10:44 AM EDT, Thu September 26, 2013
If you don't know what all those health insurance buzz-words like "co-pay" and "premium" mean, you're not alone.
updated 5:37 PM EDT, Wed October 2, 2013
Obamacare is expected to increase demand for medical services. That, plus a shortage of doctors, may mean the appointment has to wait.
updated 11:57 AM EDT, Wed October 2, 2013
Lauren Zanardelli and Graham Foster are the kind of customers the government needs to make Obamacare work.
updated 11:33 AM EDT, Sun August 11, 2013
Reince Priebus said the GOP will campaign against what he describes as "European, socialist healthcare" in the upcoming election.
It's a popular assertion, but is it true? The CNN Politics team hunts down the facts.
Our map shows which states have expanded Medicaid and includes links to marketplace options.
Some may offer help navigating the new health insurance marketplace for a fee. Others will warn that you will need a new Medicare card.
updated 12:57 PM EDT, Mon September 30, 2013
Who's in, who's out... and what about the costs? CNN Chief Medical Correspondent Dr. Sanjay Gupta breaks down Obamacare.
Consumers can avoid the exchanges by buying plans directly from insurers or through brokers. But should they?
Here's the first look at insurance premiums on 36 exchanges run by the federal government.
updated 10:46 AM EDT, Wed September 25, 2013
If we want to be realistic about health care reform, we have to acknowledge that everything comes with a tradeoff, Dr. Aaron E. Carroll says.
Check out our page with all things you need to know about Obamacare and how it will affect you.