Skip to main content
Part of complete coverage on

Feeling glum, happy, aroused? New technology can detect your mood

<strong>New tech that senses how you're feeling inside:</strong> is it the key to self-knowledge and the future of communication? Or just the return of the phony "mood ring"? Check out our gallery of the top mood-sensing technology in development. New tech that senses how you're feeling inside: is it the key to self-knowledge and the future of communication? Or just the return of the phony "mood ring"? Check out our gallery of the top mood-sensing technology in development.
HIDE CAPTION
Computing your mood
Computing your mood
Computing your mood
Computing your mood
Computing your mood
Computing your mood
Computing your mood
Computing your mood
Computing your mood
Computing your mood
Computing your mood
Computing your mood
<<
<
1
2
3
4
5
6
7
8
9
10
11
12
>
>>
STORY HIGHLIGHTS
  • Explore the fast-developing world of technology that can read your mood
  • Cameras and electronic sensors can provide information on a person's state of mind
  • It opens up the possibility of communicating emotions we don't even realize we have
  • Advertisers, medical researchers and teachers are all interested in the tech

(CNN) -- A long distance drive can be lonely with only a radio for company, and if the driver is stressed or tired it becomes dangerous.

A car that could understand those feelings might prevent an accident, using emotional data to flag warning signs. Sensors could nest in the steering wheel and door handles to pick up electric signals from the skin. Meanwhile a camera mounted on the windshield could analyze facial expressions.

Alternatively, if the driver exhibits stress, the vehicle's coordinated sensors could soften the light and music, or broaden the headlight beams to compensate for loss of vision. A distressed state could be broadcast as a warning to other motorists by changing the color of the vehicle's conductive paint.

This empathic vehicle is the goal of AutoEmotive, a research project from the Affective Computing group at MIT's media lab, who are focused on exploring the potential of emotional connections with machines. 'AutoEmotive' is their latest and most integrated project, following successful efforts to make interfaces of everything from bras to mirrors.

Researchers believe the concept is destined for the mainstream, and have fielded interest from manufacturers. "We have already tested most of these sensors", says Javier Rivera, MIT researcher and project leader. "The hardware required could easily be built into cars. Most cars have cameras anyway; you just have more to capture the physiology. It could be done unobtrusively."

Read: Embracing big brother: How facial recognition could help fight crime

Not time like the present

But we don't have to wait for emotion sensors. They are flooding into a new market, using a growing range of mood metrics to suit diverse applications. Voice recognition app Beyond Verbal can tell you if you flirt too much in just 20 seconds. A sweater that detects skin stimulation to color code your feelings is available for pre-order.

How iris recognition 'reads' your eyes
'Electronic sketch artist' fights crime

The fastest-developing method is facial recognition, led by Affectiva, a start-up that spun off from MIT's Affective Computing group three years ago. In that time, the company has amassed a database of over a billion facial expressions, which it uses to train algorithms to recognize and classify basic emotions such as happiness or anger, with over 90% accuracy.

Their flagship technology, Affdex, has been swiftly adopted by advertisers, who use it to test reactions to their campaigns, and modify them accordingly. Market research partners Millward Brown have standardized its use for Fortune 500 clients including PepsiCo and Unilever.

"In the past this technology was confined to laboratories because of high cost and slow turnaround," explains Nick Langeveld, Chief Executive Officer of Affectiva. "We've cracked those issues; the cost is very low as the service is over the web, and it can be turned around almost immediately after the data is collected."

Competitor Emotient also specializes in face recognition, but its primary target is the retail sector. Their software is on trial in stores, pinpointing 44 facial movements to monitor emotional reactions of staff and shoppers, as well as demographic information including age and gender. From customer satisfaction to employee morale, the benefits to business are obvious, and Emotient claim major retail partners plan to make the system permanent.

Read: Bionic fashion: Wearable tech that will turn man into machine by 2015

Medical applications

It is also time to bring these tools into clinical practice, believes Dr. Erik Viirre, a San Diego neurophysiologist. "While so many medications list suicide risk as a possible side effect I think we have to use biosensors, and there is a big push within psychiatry to bring them in. Thought disorders could be picked up much quicker and used to determine treatment."

Viirre has studied headaches extensively and found that contributing factors build up days before they strike, including mood. He argues a multi-sensor approach combining brain scans, genetic tests and emotion sensing could dramatically improve treatment.

But emotion sensors are currently limited in their capacity to differentiate nuanced expression, says Tadas BaltruĊĦaitis of the University of Cambridge Computer Laboratory, who has published research on the subject.

"It is easy to train a computer to recognize basic emotions, such as fear or anger. It is more difficult to recognize more complex emotional states, that might also be culturally dependent, such as confusion, interest and concentration."

Read: Diana Eng melds high tech with high fashion

But there is scope for rapid progress: "The field is relatively new, and only recently has it been possible to recognize emotions in real world environments with a degree of accuracy. The approaches are getting better every year, leading to more subtle expressions being recognizable by machines."

BaltruĊĦaitis adds that combined sensors -- as with 'AutoEmotive' -- that pick up signals from skin, pulse, face, voice and more, could be key to progress.

Buyers beware

I think variations are already being used in places like airports and we would never know
Chris Dancy, futurist

In this post-NSA climate, companies are keen to head off privacy concerns. Affectiva and Emotient are vehement that all their data has been gathered with permission from the subjects, while the latter defend their use of recognition software in stores by saying it does not record personal details.

But the technology is prone to abuse, according to futurist and information systems expert Chris Dancy. "I think variations are already being used in places like airports and we would never know", he says. "I can't imagine a system to take value readings of my mind for a remote company being used for good. It's a dark path."

Producers claim they strictly control the use of their sensors, but facial recognition technology is proliferating. UK supermarket Tesco could face legal action for introducing it in stores without permission, while San Diego police have been quietly issued with a phone-based version.

Read: Google Glass adds style, prescription lenses

Inventing the 3-D motion sensor
How to hack an iPhone fingerprint sensor

Ironically, Dancy -- a leading proponent of the Quantified Self movement -- is pursuing many of the same insights into emotion as advertisers, but by alternative means and for personal goals. He keeps himself connected to sensors measuring pulse, REM sleep, blood sugar and more, which he cross-references against environmental input to see how the two correlate, using the results to give him understanding and influence over his mind state.

'Moodhacking' has become a popular practice among the technologically curious, and has given rise to successful applications. Members of London's Quantified Self Chapter created tools such as Mood Scope and Mappiness that help the user match their mental state to external events. Hackers and makers will have an even more powerful tool in March, when the crowd-funded OpenBCI device makes EEG brainwaves available to anyone with a computer for a bargain price.

For all the grassroots hostility towards corporate use of emotion sensors, there may be convergence. Affectiva are keen to market to Quantified Self demographics and an Affdex app for android is imminent. As the machine learning develops, and different industries combine to join the dots, we can all expect to be sharing a lot more.

ADVERTISEMENT
Part of complete coverage on
updated 8:37 AM EDT, Thu August 21, 2014
It's like a chair that isn't there, but magically appears whenever you need it. It's called the Chairless Chair. Find out how it works.
updated 5:39 AM EDT, Fri August 8, 2014
Engineer Alan Bond has been developing a new concept for space travel for over 30 years -- and his creation is now on the verge of lift off.
updated 8:10 AM EDT, Fri July 25, 2014
Crumbling buildings, burnt-out PCs, and cracked screens -- a new generation of "self-healing" technologies could soon consign them to history.
updated 5:09 AM EDT, Tue June 24, 2014
Discover a dancing cactus field, basketball on the Hudson River, and mind-bending 3D projections on robotic screens.
updated 1:07 PM EDT, Fri May 23, 2014
Would you live there? Design student Peter Trimble says it's actually a surprisingly good idea.
updated 10:50 AM EDT, Wed May 14, 2014
Alpha Sphere
Singing Tesla coils, musical ice cream, vegetables on drums... and this ball? Find out how "hackers" have created a new generation of instruments.
updated 12:43 PM EDT, Wed May 28, 2014
Technology has long learned from nature, but now it's going micro. "Cellular biomimicry" sees designers take inspiration from plant and animal cells.
updated 1:08 PM EDT, Wed April 9, 2014
Forget wearable tech, embeddable implants are here. Learn more about the pioneers who are implanting devices into their bodies.
updated 6:26 AM EDT, Wed May 7, 2014
A visitor of the 'NEXT Berlin' conference tries out Google Glass, a wearable computer that responds to voice commands and displays information before your eyes. It is expected to go to market in late 2013.
We know how wearable tech can enhance our fitness lives but there's evidence that its most significant application is yet to come: the workplace.
updated 4:13 AM EDT, Thu April 10, 2014
Samsung's research unit announces new way to synthesize graphene, potentially opening the door to commercial production.
updated 8:15 AM EDT, Mon March 31, 2014
iRobot, creators of vacuuming robot Roomba reveal how they learned from secret experiments -- in space travel, minefields, and toys.
updated 12:23 PM EDT, Fri March 28, 2014
A light-bulb glowing in middle of a room with no wires attached. "It's the future," says Dr Katie Hall.
updated 11:26 AM EST, Mon March 3, 2014
Knee replacements that encourage cells to regrow could soon be manufactured -- by spiders. Find out how.
updated 9:03 AM EST, Fri February 14, 2014
Meet Chuck Hull: the humble American engineer who changed the world of manufacturing.
updated 9:48 AM EST, Thu February 6, 2014
The key to self-knowledge? Or just the return of the phony "mood ring"? Check out our top mood-sensing technology in development.
ADVERTISEMENT