The advertising world spends a lot of money trying to make you feel something. They want to make you laugh, cry, feel hungry, even. Anything to sell their products and build brand loyalty. However, tracking whether or not their commercials are working is hard to do. A company called Affectiva says it can help by using video footage to collect emotional data.
Co-founder and Chief Science Officer Rana El Kaliouby says, “Emotions influence every aspect of our life; how we connect and communicate with each other and also how we make decisions. We feel that our emotions are missing from the digital world and our digital experiences.”
Affectiva is trying to change that.
Its flagship program, Affdex, asks viewers to consent to be monitored, and then users’ facial expressions are captured while they watch advertisements. Affectiva has collected 2.7 million videos in 75 different countries. That data is aggregated to analyze how emotionally engaged users are with a service or ad. The program is able to detect smiles, confusion, brow furrow, even how wrinkles may move around an eye. Affdex is now able to understand smiles better than most people can.
The program is being used primarily for advertising companies, but they are also working on real-time video communication with multiple people in a conversation. It may be used to track engagement in online courses, webinars, business meetings, even job interview videos.
Kaliouby recognizes that there are some applications that blur the line, but Affectiva has stayed away from anything without a clear opt-in. “We’re more focused on the ones where we feel we can bridge a communication gap,” says Kaliouby.
Kaliouby’s background is in computer science. She says, “I spent many, many hours with my computer and it really bugged me that it was very oblivious to my emotional state. And that kind of inspired and motivated me to build an emotionally intelligent computer.”
Watch Kai test out Affdex below:
We’re here to help you navigate this changed world and economy.
Our mission at Marketplace is to raise the economic intelligence of the country. It’s a tough task, but it’s never been more important.
In the past year, we’ve seen record unemployment, stimulus bills, and reddit users influencing the stock market. Marketplace helps you understand it all, will fact-based, approachable, and unbiased reporting.
Generous support from listeners and readers is what powers our nonprofit news—and your donation today will help provide this essential service. For just $5/month, you can sustain independent journalism that keeps you and thousands of others informed.