WASHINGTON – Facial recognition systems can produce wildly inaccurate results, especially for nonwhites, according to a U.S. government study that was released Thursday and is likely to raise fresh doubts on deployment of the artificial intelligence technology.
The study found both false positives, in which an individual is mistakenly identified, and false negatives, in which the algorithm fails to match a face to a specific person in a database.
“A false negative might be merely an inconvenience — you can’t get into your phone, but the issue can usually be remediated by a second attempt,” said lead researcher Patrick Grother.
“But a false positive in a one-to-many search puts an incorrect match on a list of candidates that warrant further scrutiny.”
The study of dozens of facial recognition algorithms showed false positive rates for Asians and blacks that were as much as 100 times higher than for whites.
The researchers from the National Institute of Standards and Technology, a government research center, also found that two algorithms assigned the wrong sex to black females almost 35 percent of the time.
The study comes amid widespread deployment of facial recognition for law enforcement, airports, border security, banking, retailing and schools and in personal technology such as unlocking smartphones.
Some activists and researchers have claimed that the potential for error is too great, with mistakes resulting in the jailing of innocent people, and that the technology could be used to create databases that may be hacked or inappropriately used.
The study found U.S.-developed face recognition systems had higher error rates for Asians, blacks and Native American groups, with the native demographic showing the highest rates of false positives.
However, some algorithms developed in Asian countries produced similar accuracy rates for matching between Asian and Caucasian faces — which the researchers said suggests these disparities can be corrected.
“These results are an encouraging sign that more diverse training data may produce more equitable outcomes,” Grother said.
Nonetheless, Jay Stanley of the American Civil Liberties Union, which has criticized the deployment of facial recognition, said the new study shows the technology is not ready for wide deployment.
“Even government scientists are now confirming that this surveillance technology is flawed and biased,” Stanley said in a statement.
“One false match can lead to missed flights, lengthy interrogations, watch-list placements, tense police encounters, false arrests or worse. But the technology’s flaws are only one concern. Face recognition technology — accurate or not — can enable undetectable, persistent, and suspicionless surveillance on an unprecedented scale.”
In a time of both misinformation and too much information, quality journalism is more crucial than ever.
By subscribing, you can help us get the story right.