Skip to main content

Voice recognition will always be stupid

By David R. Wheeler, Special to CNN
updated 7:44 AM EDT, Tue August 20, 2013
STORY HIGHLIGHTS
  • David Wheeler: We all know futility or trying to make automated systems understand us
  • We put up with it because we think the technology will soon be perfected -- it won't, he says
  • He says computers can't get human logic, ambiguity; some firms put people back on phones
  • Wheeler: Unless companies design systems based on human intelligence, they'll never work

Editor's note: David R. Wheeler lives in Lexington, Kentucky, where he is a freelance writer and a journalism professor at Asbury University. Follow him on Twitter @David_R_Wheeler

(CNN) -- "Please tell me your name," a robotic female voice says to the caller.

"Larry Valentine," the caller responds.

"You said, 'Barry Shmalenpine.' Is that right?"

So begins the exchange between actor Kevin James and the automated phone system in the 2007 film "I Now Pronounce You Chuck and Larry" -- a scene that correctly assumes moviegoers have had personal experience with the absurdity of non-human customer service.

Who hasn't? We've all waited through the recitation of menu items, none of which were related to our actual question. We've all hit zero repeatedly, hoping to be transferred to a real person. When that didn't work, maybe we even lost our temper, shouting "Representative!" over and over, whether the robot had given us that option or not.

Why hasn't there been a mass revolt against automated systems? The answer is simple: We believe that this nonsense is temporary. We believe that computers are on the cusp of being able to understand human language. And that belief, according to many linguists and cognitive scientists, is completely wrong.

David Wheeler
David Wheeler

First, there's the problem of voice recognition itself. Julie Sedivy, a professor of linguistics and psychology at the University of Calgary, told me that simply recognizing speech sounds and matching them up with specific words is much more complicated than most people realize.

"The way I say 'dog' will depend on my age, gender, geographic dialect, the particular anatomy of my vocal tract, and how quickly or formally I'm speaking," she said. "Humans are able to calibrate their perception after hearing just a couple of seconds of someone's speech, but really good speech recognition is still a problem for many programs."

Although this technology has steadily improved for the past 20 years, "speech recognition systems are still markedly inferior to human beings in understanding spoken language," said John Nerbonne, a linguist and information sciences professor based in The Netherlands. "Telephones are a particularly difficult medium because they limit the signal a good deal."

Furthermore, studies show that people almost universally hate automated phone systems, and that most customers are even willing to pay more to speak to an actual person.

"Ally Bank, Discover Card and TD Bank all have ads on television right now that brag about the fact that if you call the phone number, a real live person will answer," said Adam Goldkamp, spokesperson for GetHuman, an organization dedicated to improving customer service. Such is the sad state of the current customer service world. In other words, only now are companies starting to wake up to the lost revenue potential of frustrated customers who give up on the automated system and take their business elsewhere.

"When you see companies launching ads like these, it shows they understand that there are things they can do to increase their future revenue by giving customers what they want: an actual person to speak to when they have an issue," Goldkamp said.

Maybe one day in the future, automated systems will be able to identify our words with perfect accuracy. Even then, there is still an insurmountable problem: the ability to understand what we mean by those words.

2011 Siri: Apple's new voice recognition

"We're a long way from being able to communicate with computers in real language," said Suzanne Kemmer, director of Cognitive Sciences and associate professor of Linguistics at Rice University. "Human language has a powerful design feature that works great for normal person-to-person interactions, but is completely at odds with the way computers work."

Computers are based on formal logic and fixed categories, she explained. Human language is flexible and dynamic, and follows a cognitive logic that differs fundamentally from computers. In short, human words and grammatical structures don't have fixed meanings. Instead, they have a certain amount of vagueness and ambiguity built in, so that their meaning is highly affected by context.

Actually understanding meaning is a very different problem from voice recognition or from the auto-correct on your computer or phone, Kemmer said.

When I brought up this topic with Harvard professor Steven Pinker, one of the world's most influential linguists, he noted that major companies, by looking for statistical patterns in large datasets and applying them to user input, have largely dropped the ball when it comes to real artificial intelligence: "The stupidity of a lot of computer language understanding systems comes from the fact that they've turned their backs on genuine intelligence and satisfied themselves with statistics."

In other words, computers are still very bad at trying to guess what we mean when we say something.

They also don't get our social and emotional psychology. "Often the automated phone systems were developed with a tin ear to the way people interact with each other," Pinker told me. "They sound like people, but if you think of them as such, they are the most infuriating people in the world. When I hit '0' to get a human being, and a voice dripping with a combination of mock concern and mock confusion says, 'I'm sorry, but I did not understand your answer,' I am apt to go into a rage."

"If this were a real person," Pinker added, "she would be simultaneously stupid, mendacious, and condescending."

It's time to stop the madness. We are not on the cusp of inventing computers that understand human language. Silicon Valley can, and will, continue to strive for this goal.

In the meantime, let's stop kidding ourselves. Let's admit that computers, by themselves, are terrible at customer service. Let's admit that, at a time of economic uncertainty and job losses, we should be supporting companies that employ real people to answer our questions. Let's admit that, unless we demand change, we will be forced, forever, to deal with an automated system that thinks our name is Barry Shmalenpine.

Follow us on Twitter @CNNOpinion.

Join us on Facebook/CNNOpinion.

The opinions expressed in this commentary are solely those of David R. Wheeler.

ADVERTISEMENT
Part of complete coverage on
updated 9:49 AM EDT, Thu July 24, 2014
Patrick Cronin and Kelley Sayler say the world is seeing nonstate groups such as Ukraine's rebels wielding more power to do harm than ever before
updated 6:05 PM EDT, Wed July 23, 2014
Ukraine ambassador Olexander Motsyk places blame for the MH17 tragedy squarely at the door of Russia
updated 7:42 AM EDT, Thu July 24, 2014
Mark Kramer says Russia and its proxies have a history of shooting down civilian aircraft, often with few repercussions
updated 2:53 PM EDT, Thu July 24, 2014
Les Abend says, with rockets flying over Tel Aviv and missiles shooting down MH17 over Ukraine, a commercial pilot's pre-flight checklist just got much more complicated
updated 9:17 AM EDT, Thu July 24, 2014
Mark Kramer says Russia and its proxies have a history of shooting down civilian aircraft, often with few repercussions
updated 12:37 PM EDT, Thu July 24, 2014
Gerard Jacobs says grieving families and nations need the comfort of traditional rituals to honor the remains of loved ones, particularly in a mass disaster
updated 10:13 AM EDT, Thu July 24, 2014
The idea is difficult to stomach, but John Sutter writes that eating dog is morally equivalent to eating pig, another intelligent animal. If Americans oppose it, they should question their own eating habits as well.
updated 12:30 PM EDT, Wed July 23, 2014
Bill van Esveld says under the laws of war, civilians who do not join in the fight are always to be protected. An International Criminal Court could rule on whether Israeli airstrikes and Hamas rocketing are war crimes.
updated 8:05 AM EDT, Wed July 23, 2014
LZ Granderson says Ronald Reagan went horseback riding and took a vacation after the Korean Air Crash of 1983. So why does the GOP keep airbrushing history to bash Obama?
updated 9:38 AM EDT, Wed July 23, 2014
Aaron Miller says Kerry needs the cooperation of Hamas, Israel, Egypt and others if he is to succeed in his peacemaking efforts
updated 8:51 AM EDT, Wed July 23, 2014
Errol Louis says the tragic death of Eric Garner at the hands of the NYPD has its roots in the "broken windows" police strategy from the crime-ridden '80s.
updated 10:08 AM EDT, Wed July 23, 2014
Gordon Brown says the kidnapped Nigerian girls have been in captivity for 100 days, but the world has not forgotten them.
updated 7:27 AM EDT, Wed July 23, 2014
Ruben Navarrette says Texas Gov. Rick Perry is right to immediately send 1,000 National Guard troops to the U.S.-Mexico border in response to the border children crisis.
updated 9:56 AM EDT, Tue July 22, 2014
Ukraine's president says the downing of MH17 was a terrorist act, but Richard Barrett says it would be considered terrorism only if it was intentional
updated 4:15 PM EDT, Tue July 22, 2014
Robert McIntyre says the loophole that lets firms avoid taxes should be closed
updated 11:35 AM EDT, Tue July 22, 2014
Jeronimo Saldana and Malik Burnett say Gov. Perry's plan to send National Guard to the border won't solve the escalating immigration problem.
updated 1:42 PM EDT, Tue July 22, 2014
Sally Kohn: The world's fish and waters are polluted and under threat. Be very careful what fish you eat
updated 8:42 AM EDT, Tue July 22, 2014
Les Abend says threat information that pilots respond to is only as good as the intelligence from air traffic controllers. And none of it is a match for a radar-guided missile
updated 8:35 AM EDT, Mon July 21, 2014
Frida Ghitis: Anger over MH17 is growing against pro-Russia separatists. It's time for the Dutch government to lead, she writes
updated 8:27 AM EDT, Mon July 21, 2014
Julian Zelizer says President Obama called inequality the "defining challenge" of our time but hasn't followed through.
updated 7:57 AM EDT, Mon July 21, 2014
Gene Seymour says the 'Rockford Files' actor worked the persona of the principled coward, charming audiences on big and small screen for generations
updated 10:17 AM EDT, Mon July 21, 2014
Daniel Treisman says that when the Russian leader tied his fate to the Ukraine separatists, he set the stage for his current risky predicament
updated 12:42 PM EDT, Fri July 18, 2014
Andrew Kuchins says urgent diplomacy -- not sanctions -- is needed to de-escalate the conflict in Ukraine that helped lead to the downing of an airliner there.
updated 9:50 PM EDT, Fri July 18, 2014
Jim Hall and Peter Goelz say there should be an immediate and thorough investigation into what happened to MH17.
updated 11:07 AM EDT, Fri July 18, 2014
Pilot Bill Palmer says main defense commercial jets have against missiles is to avoid flying over conflict areas.
updated 1:55 PM EDT, Sun July 20, 2014
Valerie Jarrett says that working women should not be discriminated against because they are pregnant.
updated 3:53 PM EDT, Mon July 21, 2014
David Wheeler says the next time you get a difficult customer representative, think about recording the call.
updated 3:33 PM EDT, Fri July 18, 2014
Newt Gingrich says the more dangerous the world becomes the more Obama hides in a fantasy world.
updated 6:11 AM EDT, Fri July 18, 2014
Michael Desch: It's hard to see why anyone, including Russia and its local allies, would have intentionally targeted the Malaysian Airlines flight
updated 3:14 PM EDT, Thu July 17, 2014
LZ Granderson says we must remember our visceral horror at the news of children killed in an airstrike on a Gaza beach next time our politicians talk of war
updated 8:06 AM EDT, Thu July 17, 2014
Sally Kohn says now the House GOP wants to sue Obama for not implementing a law fast enough, a law they voted down 50 times, all reason has left the room.
updated 8:14 AM EDT, Thu July 17, 2014
A street sign for Wall Street
Sens. Elizabeth Warren, John McCain and others want to scale back the "too big to fail" banks that put us at risk of another financial collapse.
updated 4:16 PM EDT, Thu July 17, 2014
Newt Gingrich writes an open letter to Robert McDonald, the nominee to head the Veterans Administration.
updated 12:01 PM EDT, Fri July 18, 2014
Paul Begala says Dick Cheney has caused an inordinate amount of damage yet continues in a relentless effort to revise the history of his failures.
updated 10:04 AM EDT, Fri July 18, 2014
Kids who takes cell phones to bed are not sleeping, says Mel Robbins. Make them park their phones with the parents at night.
updated 12:25 PM EDT, Thu July 24, 2014
Buzz Aldrin looked at planet Earth as he stood on talcum-like lunar dust 45 years ago. He thinks the next frontier should be Mars.
updated 2:04 PM EDT, Wed July 16, 2014
Mark Zeller never thought my Afghan translator would save his life by killing two Taliban fighters who were about to kill him. The Taliban retaliated by placing him on the top of its kill list.
updated 11:18 AM EDT, Thu July 17, 2014
Jeff Yang says an all-white cast of Asian characters in cartoonish costumes is racially offensive.
updated 9:24 PM EDT, Wed July 16, 2014
Gary Ginsberg says the late John F. Kennedy Jr.'s reaction to an event in 1995 summed up his character
updated 12:41 PM EDT, Wed July 16, 2014
Meg Urry says most falling space debris lands on the planet harmlessly and with no witnesses.
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT