Skip to main content

Obamacare fix: upgrades, 24/7 trouble-shooting, and old pizza

By Z. Byron Wolf, CNN
updated 11:38 AM EST, Sat November 30, 2013
  • Two-month race to fix site hits major deadline Saturday
  • "War room" mentality takes over as contractors work with administration
  • "Ruthless prioritization" to get site working quickly may have a consequence

(CNN) -- Saturday marks the Obama administration's self-imposed deadline to fix the troubled website, for most people at least.

Deadline Day: Will Obamacare website work?

It caps a frenzied, two-month race by computer programmers and contractors sprinkled throughout the D.C. suburbs on both sides of the beltway in Maryland and Virginia.

The overall scene in response to the botched rollout of the online portal conveys a "war-room" urgency with "ruthless prioritization," many moving parts, grinding work, briefings, phone-bridges, and of course, plenty of take-out food.

Operations are overseen from a command center in Columbia, Maryland. That's where contractor QSSI has spearheaded the effort with help from some Web heavyweights.

John Engates, the Chief Technology Officer at, was an early critic of the website given a behind-the-scenes tour of the effort to fix it.

"I think it's going to work," Engates said on CNN's "The Lead."

Obamacare deadline
Insurers fear more Obamacare trouble
Obamacare small business exchange delay
Obamacare delayed for small businesses

But Luke Chung, president of Virginia-based software developer FMS Inc., called the administration's prediction the site would work at 80% capacity on or around November 30 an impractical threshold in the software world.

The site, which was taken down for overnight maintenance ahead of Saturday's deadline, is the lynchpin of Obamacare and is meant to be used by 36 states to enroll millions of Americans into health insurance now required by federal law.

Fourteen states have their own exchange sites and those, by and large, have fared better than, which was marred by crashes and other problems upon its launch October 1, embarrassing President Barack Obama, who championed the law known as Obamacare.

What happened in October?

The first thing to figure out was what went wrong -- in brief.

"Not all websites are created equal," Steven Van Roekel, the nation's chief information officer and a former personal assistant to Bill Gates who helped roll out Windows XP, told reporters on Tuesday at a White House briefing.

Unlike a site like, which he said is only to be viewed, or even an e-commerce site, which takes orders, is meant to be seamlessly multi-faceted.

A single user's experience, unbeknownst to them, could require real-time information from the social security administration, DHS, the IRS and Veterans Affairs.

Fixing it on Obama's orders was ultimately left to Jeffrey Zients, the management consultant and entrepreneur and former and future White House official.

He assembled a team, which includes Van Roekel and other experts, to oversee the overhaul being done by QSSI, other contractors and programmers.

High intensity approach

Zients conducted Tuesday's White House briefing for reporters at a clipped pace and with the no nonsense tone of a tour guide in a hurry.

The session included a teleconference with the team from QSSI in Maryland -- they couldn't spare the time to make the trip into Washington -- and programmers who drove into town from Tyson's Corner in Virginia, where most of the software work is being done.

Boehner signs up for Obamacare
One side of Obamacare, failure
One side of Obamacare, success
Where's the anonymous shopping perk?

Seeking to confound the public view of the site as an epic failure of Presidential management, Zients and the contractors described a hive of trouble-shooters huddled at twice-daily conference calls and on a round-the-clock open phone line to respond as quickly as possible to problems.

"The point of these calls is we don't have an hour or a minute to waste and therefore, we need to make sure that there is ruthless prioritization at all times as to what matters most, that there's real-time reaction if something unexpected happened, someone hit a roadblock on a fix -- so what are we going to do about that bug and how are we going to address that bug, and you get the best minds on the problems right away," said Zients.

At a satellite office of QSSI in Virginia, insiders described to CNN's Brianna Keilar a scene of programmers in marathon code-writing sessions and surrounded by stale Chinese food and half-eaten pizzas.

Back-end concern

One result of Zients' prioritization? A focus over the past two months on the experience for users who want to sign up for insurance. That approach could have a consequence.

Insurers have reported receiving duplicative and at times faulty information on the back end of the site, which raises questions about whether some people who think they're signing up for insurance will actually have it on January 1.

Insurers: Site glitches persist

Indeed, much of the system supporting - the back end for making payments and interacting with insurance companies -- still needs to be built.

But so far, it has been the difficulty for Americans trying to sign up for coverage in the first place that has partly damaged public perception of the law.

Obamacare site fix: 5 things to look for

So the programmers and the contractors pay constant attention to real-time site metrics provided by services like Chartbeat, which is used to measure exactly how many people are on the site at any given time.

A quickly flashed screen grab during the technical briefing at the White House showed there were 15,687 users on at one point. The aim is to have the site capable of hosting 50,000 at any given time and up to 800,000 per day.

That was the goal for the site back on October 1 when repeated crashes seemed to keep most everyone trying to access the site from viewing insurance options.

After hardware upgrades installed November 23 and 24 to improve capacity and after software programmers spent the past two months addressing other hiccups, supporters of the law hope the website will function as intended.

Awash in metrics

They are awash in detailed metrics at the Maryland command center. In addition to Chartbeat, another web-based program measures response times; a spike on the graph can indicate serious problems. A third measures how far each and every user makes it through the enrollment process.

Don't look for any of that data after the deadline this weekend, however. Specifics are still closely guarded details.

"We will continue to update you on metrics and user experience and our success rates as we go forward," said Zients.

CNN/ORC Poll: Are Obamacare's flaws fixable?

Boehner signs up for Obamacare

GOP Obamacare playbook: Spread negative perception

Site's Anonymous Shopper shelved

Part of complete coverage on
updated 1:35 PM EST, Fri November 21, 2014
House Speaker John Boehner said he has sued the Obama Administration in federal court over its decisions to make changes to the President's health care law.
updated 3:00 PM EST, Tue November 11, 2014
Two potential 2016 Republican presidential candidates -- Rep. Paul Ryan and Sen. Marco Rubio -- are teaming up on a proposal to replace Obamacare.
updated 9:24 PM EDT, Sun October 12, 2014
Tthe Department of Health and Human Services has released a report highlighting the impact of the law on hospital costs.
updated 11:05 AM EDT, Wed July 23, 2014
Two U.S. appeals courts issued conflicting rulings on a subject that's important to millions of people: the availability of subsidies to help purchase coverage.
updated 10:06 AM EDT, Wed July 23, 2014
It was a tale of two rulings -- the best of times and the worst of times for Obamacare in the federal appeals courts.
updated 6:00 AM EDT, Wed July 23, 2014
More than half the public says Obamacare has helped, but less than one in five say they've personally benefited from the health care law.
updated 8:01 AM EDT, Fri July 11, 2014
House Republicans are going forward with plans to sue President Barack Obama and will base their legal case on the sweeping health care law he championed and they despise.
updated 6:41 PM EDT, Tue October 29, 2013
Nationally, consumers are learning a number of well-known hospitals won't accept insurance under Obamacare.
updated 1:16 PM EST, Mon December 23, 2013
Open enrollment started October 1. Here's a step-by-step guide to navigating the insurance marketplaces, also known as exchanges.
updated 4:37 AM EDT, Sat October 19, 2013
Obamacare has survived a Supreme Court appeal, a government shutdown and ongoing challenges by opposing politicians.
updated 10:44 AM EDT, Thu September 26, 2013
If you don't know what all those health insurance buzz-words like "co-pay" and "premium" mean, you're not alone.
It's a popular assertion, but is it true? The CNN Politics team hunts down the facts.
Some may offer help navigating the new health insurance marketplace for a fee. Others will warn that you will need a new Medicare card.
updated 12:57 PM EDT, Mon September 30, 2013
Who's in, who's out... and what about the costs? CNN Chief Medical Correspondent Dr. Sanjay Gupta breaks down Obamacare.
Consumers can avoid the exchanges by buying plans directly from insurers or through brokers. But should they?
Here's the first look at insurance premiums on 36 exchanges run by the federal government.
Check out our page with all things you need to know about Obamacare and how it will affect you.