The NSA, the New York Times reports, is harvesting people’s images, millions of them per day. It's using them, we are told, to search for terrorists and other intelligence targets.
If the targets are U.S. citizens, the NSA must obtain court approval.
Facial recognition technology has taken our present national Gordian knot of privacy and security concerns through a circuitous path.
“The NSA and CIA have quite openly been working with facial recognition technology at least for the past 20 years,” says Chris Green, chief technology analyst at the Davies Murphy Group.
For a time, as that technology filtered into the private sector, it developed a life of its own. Notably “in Las Vegas,” Green says. A banned card counter can cost a casino half a million dollars in 20 minutes, so it was important for the private security industry to work on quick identification. “Vegas has been a great proving ground for facial recognition technology. It’s put a lot of money into it and really refined and honed it down.”
The groundwork laid by government agencies and the military, says Green, “created a secondary market in the private sector which is in turn is now feeding back” into government.
That feedback into government is also largely being financed by the government. Especially since 9/11.
“I would have to guess its 70 percent or higher government dollars,” says Chris Boehnen, who leads the Secure Computer Vision Team at Oak Ridge National Laboratory.
When it comes down to what that public and private investment has brought us, it’s important to separate the fanciful from the factual, says Boehnen.
Looking at Facebook’s tagging feature, for example, “you could easily get the idea that modern technology is capable of taking all of Facebook’s images and telling who you are, and that’s very inaccurate from a technical standpoint.”
Facebook, says Boehnen, almost certainly employs shortcuts that make it appear far more advanced than it is. For example, Facebook most likely isn’t comparing your photo album to all photo albums on Facebook from here to Mongolia. It’s comparing the faces in your album, most likely, to your friends, or maybe your friends’ friends.
In the real world, facial recognition technology can be both much better, and much worse. Patrick Grother tests commercially developed facial recognition technologies for the National Institute of Standards and Technology. He says in a recent test, theyenrolled 1.6 million people and achieved a 96 percent recognition rate. Meaning that if they were searching for one person out of a group of 1.6 million, they could pick that person out successfully 96 percent of the time.
But that comes with a big if: it only works if the photos being used are controlled – well lit, frontal photos like a passport or a driver’s license photo. (Incidentally, that’s why you’re not supposed to smile in those photos – all the better to identify you or someone impersonating you).
This is tremendously useful for government agencies who are trying to determine if someone is fraudulently registering a new passport or driver’s license under another name. Less so if you’re trying to pick a bomber out of a crowded mall.
Grother is not privy to what the NSA or CIA use. Green, with Davies Murphy Group, suspects those agencies enjoy even higher success rates “in the high 99 percent range.” But even then, the accuracy is only as good as the data, a.k.a., the photos one is comparing. Clear photos make for high identification rates. Green says modern day surveillance cameras and Closed Circuit TV cameras can often provide such clear images.