Civil rights activists have successfully pushed for bans on police use of facial recognition in cities like Oakland, San Francisco, and Somerville, Massachusetts. Now, a coalition led by Amnesty International is setting its sights on the nation's biggest city—New York—as part of a drive for a global moratorium on government use of the technology.
Amnesty's #BantheScan campaign is backed by Legal Aid, the New York Civil Liberties Union, and AI for the People, among other groups. After New York, the group plans to target New Delhi and Ulaanbaatar in Mongolia.
“New York is the biggest city in the country,” says Michael Kleinman, director of Amnesty International's Silicon Valley Initiative. “If we can get New York to ban this technology, that shows that it's possible to ban it almost anywhere.”
Activists have long sounded the alarm about the risks of police use of facial recognition. The technology is less accurate on dark-skinned people, contributing to the wrongful arrests of Black men in New Jersey and Michigan. Last year, BuzzFeed News reported the NYPD had run over 11,000 facial recognition searches using software purchased from Clearview AI.
Banning facial recognition in the city won't be easy. Digital rights groups have long pushed the New York City Council to ban use of facial recognition by city agencies. Though the council has taken up bills regulating landlords' or businesses' use of the tech, it has not advanced a ban. So Amnesty has shifted some attention to Albany, pushing for the state to enact Senate Bill S79, introduced by state Senator Brad Hoylman, which would ban law enforcement use of biometric surveillance technology, including facial recognition. The bill would also create a task force to recommend regulations around its use.
“We could then evaluate whether law enforcement should be permitted to use this technology and if so, create a regulatory framework to determine, what's prohibited, minimum accuracy standards, and protections for due process and privacy,” Hoylman says.
In a statement, NYPD spokesperson Detective Sophia Mason said, “The NYPD uses facial recognition as a limited investigative tool, comparing a still image from a surveillance video to a pool of lawfully possessed arrest photos. This technology helps bring justice to victims of crimes. Any facial recognition match is solely an investigative lead and not probable cause for arrest—no enforcement action is ever taken solely on the basis of a facial recognition match.”
Amnesty International's Kleinman questions whether facial recognition is a vital investigative tool. “The police already have tremendous resources,” he says. “The idea that without facial recognition, they're left powerless ignores the powers they already have.
“That kind of argument, ‘If you don't allow us to do X then we can't do our job,' can be used to justify any level of surveillance,” Kleinman says. “There's no stopping point to that argument.”
In December, the NYPD released a list of surveillance technologies the department uses in its investigations, including facial recognition, in response to a new city law. The disclosures covered dozens of technologies, including closed-circuit TV cameras, license plate reading cameras, drone surveillance, Wi-Fi geolocation services, and more.
Chief among Amnesty International's concerns about facial recognition is the potential “chilling effect” on and activism. .
The WIRED Guide to Artificial Intelligence
Supersmart algorithms won't take all the jobs, But they are learning faster than ever, doing everything from medical diagnostics to serving up ads.
The concern is top of mind for Dwreck Ingram, organizer and co-founder of the advocacy group Warriors In The Garden, another member of the #BantheScan campaign. Last summer, during the George Floyd protests, the NYPD used facial recognition to identify Ingram, confronting him outside his apartment. Ingram believes the comparison photos were sourced from his Instagram. Police claim Ingram assaulted a police officer, a felony offense, by allegedly shouting into an officer's ear using a megaphone. Eventually, Ingram turned himself in to police and the Manhattan district attorney reduced the charge to a misdemeanor.