General Intelligence

The Shoddy Science Behind Emotional Recognition Tech

People’s facial expressions line up with their emotions less than half the time

Dave Gershgorn
OneZero
Published in
2 min readFeb 19, 2021
Photo illustration source: ozgurdonmaz/Getty Images

OneZero’s General Intelligence is a roundup of the most important artificial intelligence and facial recognition news of the week.

Facial recognition isn’t just for verifying a person’s identity. In recent years, researchers and startups have focused on other ways to apply the technology, like emotion recognition, which tries to read facial expressions to understand what a person is feeling.

For instance, Find Solution AI, a company based in Hong Kong that was recently featured in CNN Business, is selling its technology to schools and colleges, where it scans students’ faces and monitors their feelings in virtual classrooms. Theoretically, systems like these could detect whether children are paying attention or expressing frustration that indicates difficulty with learning the class material.

Academics and A.I. ethics researchers, however, are quick to point out that this technology relies on questionable science and that there are serious ethical concerns around who the technology is used to surveil.

Kate Crawford, co-founder of the AI Now Institute and senior principal researcher at Microsoft Research, pushed back on Find Solution AI’s claims that its technology could tell what children were feeling.

Find Solution AI, and most other emotion recognition startups, base their technology on the work of Paul Ekman, a psychologist who published popular work on the similarities between facial expressions around the world and popularized the idea of “seven universal emotions.” Actor Tim Roth even played a dramatized version of Ekman in the Fox drama Lie to Me.

That research has not translated well into the real world. A TSA program that trained agents to spot terrorists using Ekman’s work found little scientific basis, didn’t result in…

--

--

Dave Gershgorn
OneZero

Senior Writer at OneZero covering surveillance, facial recognition, DIY tech, and artificial intelligence. Previously: Qz, PopSci, and NYTimes.