Skip to main content

Voice recognition will always be stupid

By David R. Wheeler, Special to CNN
updated 7:44 AM EDT, Tue August 20, 2013
STORY HIGHLIGHTS
  • David Wheeler: We all know futility or trying to make automated systems understand us
  • We put up with it because we think the technology will soon be perfected -- it won't, he says
  • He says computers can't get human logic, ambiguity; some firms put people back on phones
  • Wheeler: Unless companies design systems based on human intelligence, they'll never work

Editor's note: David R. Wheeler lives in Lexington, Kentucky, where he is a freelance writer and a journalism professor at Asbury University. Follow him on Twitter @David_R_Wheeler

(CNN) -- "Please tell me your name," a robotic female voice says to the caller.

"Larry Valentine," the caller responds.

"You said, 'Barry Shmalenpine.' Is that right?"

So begins the exchange between actor Kevin James and the automated phone system in the 2007 film "I Now Pronounce You Chuck and Larry" -- a scene that correctly assumes moviegoers have had personal experience with the absurdity of non-human customer service.

Who hasn't? We've all waited through the recitation of menu items, none of which were related to our actual question. We've all hit zero repeatedly, hoping to be transferred to a real person. When that didn't work, maybe we even lost our temper, shouting "Representative!" over and over, whether the robot had given us that option or not.

Why hasn't there been a mass revolt against automated systems? The answer is simple: We believe that this nonsense is temporary. We believe that computers are on the cusp of being able to understand human language. And that belief, according to many linguists and cognitive scientists, is completely wrong.

David Wheeler
David Wheeler

First, there's the problem of voice recognition itself. Julie Sedivy, a professor of linguistics and psychology at the University of Calgary, told me that simply recognizing speech sounds and matching them up with specific words is much more complicated than most people realize.

"The way I say 'dog' will depend on my age, gender, geographic dialect, the particular anatomy of my vocal tract, and how quickly or formally I'm speaking," she said. "Humans are able to calibrate their perception after hearing just a couple of seconds of someone's speech, but really good speech recognition is still a problem for many programs."

Although this technology has steadily improved for the past 20 years, "speech recognition systems are still markedly inferior to human beings in understanding spoken language," said John Nerbonne, a linguist and information sciences professor based in The Netherlands. "Telephones are a particularly difficult medium because they limit the signal a good deal."

Furthermore, studies show that people almost universally hate automated phone systems, and that most customers are even willing to pay more to speak to an actual person.

"Ally Bank, Discover Card and TD Bank all have ads on television right now that brag about the fact that if you call the phone number, a real live person will answer," said Adam Goldkamp, spokesperson for GetHuman, an organization dedicated to improving customer service. Such is the sad state of the current customer service world. In other words, only now are companies starting to wake up to the lost revenue potential of frustrated customers who give up on the automated system and take their business elsewhere.

"When you see companies launching ads like these, it shows they understand that there are things they can do to increase their future revenue by giving customers what they want: an actual person to speak to when they have an issue," Goldkamp said.

Maybe one day in the future, automated systems will be able to identify our words with perfect accuracy. Even then, there is still an insurmountable problem: the ability to understand what we mean by those words.

2011 Siri: Apple's new voice recognition

"We're a long way from being able to communicate with computers in real language," said Suzanne Kemmer, director of Cognitive Sciences and associate professor of Linguistics at Rice University. "Human language has a powerful design feature that works great for normal person-to-person interactions, but is completely at odds with the way computers work."

Computers are based on formal logic and fixed categories, she explained. Human language is flexible and dynamic, and follows a cognitive logic that differs fundamentally from computers. In short, human words and grammatical structures don't have fixed meanings. Instead, they have a certain amount of vagueness and ambiguity built in, so that their meaning is highly affected by context.

Actually understanding meaning is a very different problem from voice recognition or from the auto-correct on your computer or phone, Kemmer said.

When I brought up this topic with Harvard professor Steven Pinker, one of the world's most influential linguists, he noted that major companies, by looking for statistical patterns in large datasets and applying them to user input, have largely dropped the ball when it comes to real artificial intelligence: "The stupidity of a lot of computer language understanding systems comes from the fact that they've turned their backs on genuine intelligence and satisfied themselves with statistics."

In other words, computers are still very bad at trying to guess what we mean when we say something.

They also don't get our social and emotional psychology. "Often the automated phone systems were developed with a tin ear to the way people interact with each other," Pinker told me. "They sound like people, but if you think of them as such, they are the most infuriating people in the world. When I hit '0' to get a human being, and a voice dripping with a combination of mock concern and mock confusion says, 'I'm sorry, but I did not understand your answer,' I am apt to go into a rage."

"If this were a real person," Pinker added, "she would be simultaneously stupid, mendacious, and condescending."

It's time to stop the madness. We are not on the cusp of inventing computers that understand human language. Silicon Valley can, and will, continue to strive for this goal.

In the meantime, let's stop kidding ourselves. Let's admit that computers, by themselves, are terrible at customer service. Let's admit that, at a time of economic uncertainty and job losses, we should be supporting companies that employ real people to answer our questions. Let's admit that, unless we demand change, we will be forced, forever, to deal with an automated system that thinks our name is Barry Shmalenpine.

Follow us on Twitter @CNNOpinion.

Join us on Facebook/CNNOpinion.

The opinions expressed in this commentary are solely those of David R. Wheeler.

ADVERTISEMENT
Part of complete coverage on
updated 5:01 PM EDT, Wed October 22, 2014
Paul Callan says the grand jury is the right process to use to decide if charges should be brought against the police officer
updated 12:19 PM EDT, Thu October 23, 2014
Theresa Brown says the Ebola crisis brought nurses into the national conversation on health care. They need to stay there.
updated 6:35 PM EDT, Tue October 21, 2014
Patrick Hornbeck says don't buy the hype: The arguments the Vatican used in its interim report would have virtually guaranteed that same-sex couples remained second class citizens
updated 9:36 AM EDT, Fri October 24, 2014
Paul Begala says Iowa's U.S. Senate candidate, Joni Ernst, told NRA she has right to use gun to defend herself--even from the government. But shooting at officials is not what the Founders had in mind
updated 6:08 PM EDT, Thu October 23, 2014
John Sutter: Why are we so surprised the head of a major international corporation learned another language?
updated 5:54 PM EDT, Thu October 23, 2014
Jason Johnson says Ferguson isn't a downtrodden community rising up against the white oppressor, but it is looking for justice
updated 12:21 PM EDT, Fri October 24, 2014
Sally Kohn says a video of little girls dressed as princesses using the F-word very loudly to condemn sexism is provocative. But is it exploitative?
updated 4:06 PM EDT, Tue October 21, 2014
Timothy Stanley says Lewinsky is shamelessly playing the victim in her affair with Bill Clinton, humiliating Hillary Clinton again and aiding her critics
updated 10:14 AM EDT, Thu October 23, 2014
Imagine being rescued from modern slavery, only to be charged with a crime, writes John Sutter
updated 12:00 PM EDT, Tue October 21, 2014
Tidal flooding used to be a relatively rare occurrence along the East Coast. Not anymore, write Melanie Fitzpatrick and Erika Spanger-Siegfried.
updated 7:35 AM EDT, Tue October 21, 2014
Carol Costello says activists, writers, politicians have begun discussing their abortions. But will that new approach make a difference on an old battleground?
updated 9:12 AM EDT, Tue October 21, 2014
Sigrid Fry-Revere says the National Organ Transplant Act has caused more Americans to die waiting for an organ than died in both World Wars, Korea, Vietnam, Afghanistan and Iraq
updated 2:51 PM EDT, Tue October 21, 2014
Crystal Wright says racist remarks like those made by black Republican actress Stacey Dash do nothing to get blacks to join the GOP
updated 6:07 PM EDT, Tue October 21, 2014
Mel Robbins says by telling her story, Monica Lewinsky offers a lesson in confronting humiliating mistakes while keeping her head held high
updated 9:29 AM EDT, Mon October 20, 2014
Cornell Belcher says the story of the "tea party wave" in 2010 was bogus; it was an election determined by ebbing Democratic turnout
updated 4:12 PM EDT, Mon October 20, 2014
Les Abend says pilots want protocols, preparation and checklists for all contingencies; at the moment, controlling a deadly disease is out of their comfort zone
updated 11:36 PM EDT, Sun October 19, 2014
David Weinberger says an online controversy that snowballed from a misogynist attack by gamers into a culture war is a preview of the way news is handled in a world of hashtag-fueled scandal
updated 8:23 AM EDT, Mon October 20, 2014
Julian Zelizer says Paul Krugman makes some good points in his defense of President Obama but is premature in calling him one of the most successful presidents.
updated 10:21 PM EDT, Sun October 19, 2014
Conservatives can't bash and slash government and then suddenly act surprised if government isn't there when we need it, writes Sally Kohn
updated 8:05 AM EDT, Wed October 22, 2014
ISIS is looking to take over a good chunk of the Middle East -- if not the entire Muslim world, write Peter Bergen and Emily Schneider.
updated 9:00 AM EDT, Mon October 20, 2014
The world's response to Ebola is its own sort of tragedy, writes John Sutter
updated 4:33 PM EDT, Fri October 17, 2014
Hidden away in Russian orphanages are thousands of children with disabilities who aren't orphans, whose harmful treatment has long been hidden from public view, writes Andrea Mazzarino
updated 1:22 PM EDT, Sat October 18, 2014
When you hear "trick or treat" this year, think "nudge," writes John Bare
updated 12:42 AM EDT, Sat October 18, 2014
The more than 200 kidnapped Nigerian schoolgirls have become pawns in a larger drama, writes Richard Joseph.
updated 9:45 AM EDT, Fri October 17, 2014
Peggy Drexler said Amal Alamuddin was accused of buying into the patriarchy when she changed her name to Clooney. But that was her choice.
updated 4:43 PM EDT, Thu October 16, 2014
Ford Vox says the CDC's Thomas Frieden is a good man with a stellar resume who has shown he lacks the unique talents and vision needed to confront the Ebola crisis
updated 4:58 AM EDT, Sat October 18, 2014
How can such a numerically small force as ISIS take control of vast swathes of Syria and Iraq?
updated 9:42 AM EDT, Fri October 17, 2014
How big a threat do foreign fighters in Syria and Iraq pose to the West? It's a question that has been much on the mind of policymakers and commentators.
updated 8:21 AM EDT, Fri October 17, 2014
More than a quarter-million American women served honorably in the Iraq and Afghanistan wars. Now they are home, we have an obligation to help them transition back to civilian life.
updated 4:27 PM EDT, Thu October 16, 2014
Paul Begala says Rick Scott's deeply weird refusal to begin a debate because rival Charlie Crist had a fan under his podium spells disaster for the Florida governor--delighting Crist
updated 12:07 AM EDT, Thu October 16, 2014
The longer we wait to engage on Ebola, the more limited our options will become, says Marco Rubio.
updated 7:53 AM EDT, Wed October 15, 2014
Democratic candidates who run from President Obama in red states where he is unpopular are making a big mistake, says Donna Brazile
updated 12:29 AM EDT, Thu October 16, 2014
At some 7 billion people, the world can sometimes seem like a crowded place. But if the latest estimates are to be believed, then in less than a century it is going to feel even more so -- about 50% more crowded, says Evan Fraser
updated 12:53 PM EDT, Mon October 20, 2014
Paul Callan says the Ebola situation is pointing up the need for better leadership
updated 6:45 PM EDT, Wed October 15, 2014
Nurses are the unsung heroes of the Ebola outbreak. Yet, there are troubling signs we're failing them, says John Sutter
updated 1:00 PM EDT, Wed October 15, 2014
Dean Obeidallah says it's a mistake to give up a business name you've invested energy in, just because of a new terrorist group
updated 7:01 PM EDT, Wed October 15, 2014
Fear of Ebola is contagious, writes Mel Robbins; but it's time to put the disease in perspective
updated 1:44 PM EDT, Tue October 14, 2014
Oliver Kershaw says that if Big Tobacco is given monopoly of e-cigarette products, public health will suffer.
updated 9:35 AM EDT, Sat October 18, 2014
Stop thinking your job will make you happy.
updated 10:08 PM EDT, Tue October 14, 2014
Ruben Navarrette says it's time to deal with another scandal involving the Secret Service — one that leads directly into the White House.
updated 7:25 AM EDT, Tue October 14, 2014
Americans who choose to fight for militant groups or support them are young and likely to be active in jihadist social media, says Peter Bergen
updated 9:03 AM EDT, Mon October 13, 2014
Stephanie Coontz says 11 years ago only one state allowed same sex marriage. Soon, some 60% of Americans will live where gays can marry. How did attitudes change so quickly?
updated 4:04 PM EDT, Tue October 14, 2014
Legalizing assisted suicide seems acceptable when focusing on individuals. But such laws would put many at risk of immense harm, writes Marilyn Golden.
updated 9:07 AM EDT, Mon October 13, 2014
Julian Zelizer says the issues are huge, but both parties are wrestling with problems that alienate voters
updated 6:50 PM EDT, Mon October 13, 2014
Mel Robbins says the town's school chief was right to cancel the season, but that's just the beginning of what needs to be done
updated 11:43 AM EDT, Sat October 11, 2014
He didn't discover that the world was round, David Perry writes. So what did he do?
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT