Skip to main content

Don't slam Canada for mammogram study

By H. Gilbert Welch
updated 7:42 AM EST, Wed February 19, 2014
STORY HIGHLIGHTS
  • A recent Canadian study found that mammogram screenings don't reduce cancer deaths
  • Mammographers slammed it, saying researchers cheated and screening machines were old
  • Gilbert Welch: Cheating charges unfounded, and pro-screening studies used older machines
  • Welch: The real problem is that mammography results in women getting treatment they don't need

Editor's note: H. Gilbert Welch is a professor of medicine at the Dartmouth Institute for Health Policy and Clinical Practice and author of "Should I Be Tested for Cancer? Maybe Not and Here's Why" (University of California Press) and co-author of "Overdiagnosed: Making People Sick in the Pursuit of Health."

(CNN) -- We all like to think medical care is about science, but too often it's about professional interests.

Last week, a 25-year follow-up of the Canadian National Breast Screening Study was published -- one of the eight major randomized trials of screening mammography. The headline was simple: Mammogram screenings don't reduce cancer death rates.

The reaction by some American mammographers was predictable -- discredit the study. It's predictable because it is exactly what they did when they didn't like the first findings of the study published more than 20 years ago.

The effort by the American College of Radiology to discredit the Canadian trial relies on two allegations:

H. Gilbert Welch
H. Gilbert Welch

The investigators were cheating: Let's look at the background on this. Randomized trials are a critical tool for clinical researchers. Study participants are placed at random in either one group (in this case those who get mammograms) or the other (those who do not). Who is in which group is solely based on the play of chance -- a flip of a coin.

The allegation of cheating -- purposely putting women whom researchers knew had advanced cancers in the mammography group -- is an incredibly serious one. It sure was taken seriously by Canada's National Cancer Institute. It launched a two-year independent review of the entire randomization process. In 1997, the review found no credible evidence of cheating.

But that didn't stop the allegation from being trotted out last week. The new study provides evidence that randomization did exactly what it is supposed to do: It created two identical groups of women. The rate of death in the two groups was exactly the same, every year, for 25 years. That can't happen by cheating -- that can only happen when the groups are formed solely by chance.

It sounded as if Canada were Botswana. Like the nation had only recently gotten electric power and was still struggling to train doctors.
Gilbert Welch

Canada is a Third World country: More specifically, the Canadians used old mammography machines that produced inadequate images, interpreted by inadequate mammographers.

It sounded as if Canada were Botswana, as if the nation had only recently gotten electric power and was still struggling to train doctors.

For mammographers who need to point to the benefits demonstrated by earlier trials of mammography, this is an odd allegation. Why? Because the other trials used even older technology. In fact, one of the trials most favorable to screening -- the Health Insurance Plan of New York's -- dates from two decades before Canada's, in the early 1960s, when mammography technologies were primitive.

Yet, in both New York and Canada, outmoded technology did exactly what it was supposed to do. It found small breast cancers.

Armed with these two allegations, the mammographers followed a well-worn strategy: Make the allegations often and loudly enough and maybe they will stick.

To be clear, not all mammographers share this view. A new generation has openly acknowledged the problems of mammography. But many in the old guard are more likely to attack any suggestion that screening doesn't work as well as advertised, characterizing researchers who raise the possibility as "malicious" or "dangerous" and questioning the editorial policies of the journals that publish their work.

It's time to stop the unfounded allegations. It might be standard procedure for politics but not for science. Too much energy has been devoted to discrediting the Canadian study and not enough to understanding it.

To make sense of information the Canadian trial offers, you need to understand its unique design -- specifically what is being compared with what. Most of the other randomized trials simply compared regular mammography with doing nothing.

In the Canadian trial, one group received a regular physical exam of the breast -- a very careful exam performed by specially trained nurses. The other group received the same regular physical exam plus regular mammography. In other words, the trial tested the usefulness of adding mammography to a physical exam in an effort to detect abnormalities that are too small to feel.

And the trial showed that finding these "too small to feel" abnormalities doesn't help women live longer.

That's really important information. It doesn't mean that mammography can't help at all -- it is extremely challenging to standardize a physical exam of the breast across an entire population. It does mean, however, that if we are going to do mammography, we should be using it to find big, important things -- not small, unimportant things.

Further, the Canadian trial confirms that the harm of being overdiagnosed by screening mammography is real: One in five invasive cancers found by screening represents overdiagnosis. Overdiagnosis happens when cellular abnormalities meet the pathologic definition of "cancer," yet never progress to cause clinical disease. Overdiagnosed women are told they have cancer, are treated for cancer, yet their "cancer" is not destined to cause them any problems.

It is important to recognize this estimate doesn't include the smallest, earliest form of breast cancer found only by mammography -- ductal carcinoma in situ or DCIS.

If overdiagnosis is a problem in invasive cancer, you can imagine it might be a greater problem for a smaller, earlier form of cancer. Even mammography's old guard objects to having DCIS included in estimates of the amount of overdiagnosis.

Why do they object? Because so much of DCIS represents overdiagnosis, including it makes the estimate even higher.

It's time to get the science back in screening mammography and to recognize that mammographers may not be the ideal source for balanced information. It's too much like asking the dentists for balanced information about routine dental X-rays.

Follow us on Twitter @CNNOpinion.

Join us on Facebook/CNNOpinion.

The opinions expressed in this commentary are solely those of H. Gilbert Welch.

ADVERTISEMENT
Part of complete coverage on
updated 12:11 PM EDT, Fri August 29, 2014
Leon Aron says the U.S. and Europe can help get Russia out of Ukraine by helping Ukraine win its just war, sharing defense technologies and intelligence
updated 1:24 PM EDT, Fri August 29, 2014
Timothy Stanley the report on widespread child abuse in a British town reveals an institutional betrayal by police, social services and politicians. Negligent officials must face justice
updated 9:06 PM EDT, Fri August 29, 2014
Peter Bergen and David Sterman say a new video of an American suicide bomber shows how Turkey's militant networks are key to jihadists' movement into Syria and Iraq. Turkey must stem the flow
updated 11:16 AM EDT, Thu August 28, 2014
Whitney Barkley says many for-profit colleges deceive students, charge exorbitant tuitions and make false promises
updated 10:34 AM EDT, Fri August 29, 2014
Mark O'Mara says the time has come to decide whether we really want police empowered to shoot those they believe are 'fleeing felons'
updated 10:32 AM EDT, Thu August 28, 2014
Bill Frelick says a tool of rights workers is 'naming and shaming,' ensuring accountability for human rights crimes in conflicts. But what if wrongdoers know no shame?
updated 10:43 PM EDT, Thu August 28, 2014
Jay Parini says, no, a little girl shouldn't fire an Uzi, but none of should have easy access to guns: The Second Amendment was not written to give us such a 'right,' no matter what the NRA says
updated 1:22 PM EDT, Sat August 30, 2014
Terra Ziporyn Snider says many adolescents suffer chronic sleep deprivation, which can indeed lead to safety problems. Would starting school an hour later be so wrong?
updated 9:30 AM EDT, Fri August 29, 2014
Peggy Drexler says after all the celebrity divorces, it's tempting to ask the question. But there are still considerable benefits to getting hitched
updated 2:49 PM EDT, Fri August 29, 2014
The death of Douglas McAuthur McCain, the first American killed fighting for ISIS, highlights the pull of Syria's war for Western jihadists, writes Peter Bergen.
updated 6:42 PM EDT, Tue August 26, 2014
Former ambassador to Syria Robert Ford says the West should be helping moderates in the Syrian armed opposition end the al-Assad regime and form a government to focus on driving ISIS out
updated 9:21 AM EDT, Wed August 27, 2014
Ruben Navarrette says a great country does not deport thousands of vulnerable, unaccompanied minors who fled in fear for their lives
updated 9:19 AM EDT, Wed August 27, 2014
Robert McIntyre says Congress is the culprit for letting Burger King pay lower taxes after merging with Tim Hortons.
updated 7:35 PM EDT, Tue August 26, 2014
Wesley Clark says the U.S. can offer support to its Islamic friends in the region most threatened by ISIS, but it can't fight their war
updated 7:26 AM EDT, Wed August 27, 2014
Jeff Yang says the tech sector's diversity numbers are embarrassing and the big players need to do more.
updated 4:53 PM EDT, Tue August 26, 2014
America's painful struggle with racism has often brought great satisfaction to the country's rivals, critics, and foes. The killing of Michael Brown and its tumultuous aftermath has been a bonanza.
updated 4:19 PM EDT, Tue August 26, 2014
Ed Bark says in this Emmy year, broadcasters CBS, ABC and PBS can all say they matched or exceeded HBO. These days that's no small feat
updated 3:19 PM EDT, Tue August 26, 2014
Rick Martin says the death of Robin Williams brought back memories of his own battle facing down depression as a young man
updated 11:58 AM EDT, Tue August 26, 2014
David Perry asks: What's the best way for police officers to handle people with psychiatric disabilities?
updated 3:50 PM EDT, Mon August 25, 2014
Julian Zelizer says it's not crazy to think Mitt Romney would be able to end up at the top of the GOP ticket in 2016
updated 4:52 PM EDT, Mon August 25, 2014
Roxanne Jones and her girlfriends would cheer from the sidelines for the boys playing Little League. But they really wanted to play. Now Mo'ne Davis shows the world that girls really can throw.
updated 12:29 PM EDT, Mon August 25, 2014
Peter Bergen and Emily Schneider say a YouTube video apparently posted by ISIS seems to show that the group has a surveillance drone, highlighting a new reality: Terrorist groups have technology once only used by states
updated 5:04 PM EDT, Mon August 25, 2014
Kimberly Norwood is a black mom who lives in an affluent neighborhood not far from Ferguson, but she has the same fears for her children as people in that troubled town do
updated 5:45 PM EDT, Fri August 22, 2014
It apparently has worked for France, say Peter Bergen and Emily Schneider, but carries uncomfortable risks. When it comes to kidnappings, nations face grim options.
updated 1:27 PM EDT, Tue August 26, 2014
John Bare says the Ice Bucket Challenge signals a new kind of activism and peer-to-peer fund-raising.
updated 8:31 AM EDT, Fri August 22, 2014
James Dawes says calling ISIS evil over and over again could very well make it harder to stop them.
updated 9:05 PM EDT, Sat August 23, 2014
As the inquiry into the shooting of Michael Brown continues, critics question the prosecutor's impartiality.
updated 6:47 PM EDT, Fri August 22, 2014
Newt Gingrich says it's troubling that a vicious group like ISIS can recruit so many young men from Britain.
updated 10:50 AM EDT, Thu August 21, 2014
David Weinberger says Twitter and other social networks have been vested with a responsibility, and a trust, they did not ask for.
updated 7:03 AM EDT, Fri August 22, 2014
John Inazu says the slogan "We are Ferguson" is meant to express empathy and solidarity. It's not true: Not all of us live in those circumstances. But we all made them.
updated 8:23 AM EDT, Fri August 22, 2014
Retired Lt. Gen. Mark Hertling says he learned that the territory ISIS wants to control is amazingly complex.
updated 3:51 PM EDT, Wed August 20, 2014
Cerue Garlo says Liberia is desperate for help amid a Ebola outbreak that has touched every aspect of life.
updated 1:42 PM EDT, Thu August 21, 2014
Eric Liu says Republicans who want to restrict voting may win now, but the party will suffer in the long term.
updated 11:38 AM EDT, Thu August 21, 2014
Jay Parini: Jesus, Pope and now researchers agree: Wealth decreases our ability to sympathize with the poor.
updated 8:00 AM EDT, Thu August 21, 2014
Judy Melinek offers a medical examiner's perspective on what happens when police kill people like Michael Brown.
updated 6:03 PM EDT, Tue August 19, 2014
It used to be billy clubs, fire hoses and snarling German shepherds. Now it's armored personnel carriers and flash-bang grenades, writes Kara Dansky.
updated 1:27 PM EDT, Wed August 20, 2014
Maria Haberfeld: People who are unfamiliar with police work can reasonably ask, why was an unarmed man shot so many times, and why was deadly force used at all?
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT