Orlando Police have decided to ditch Amazon’s controversial facial recognition system Rekognition following technical issues.
Rekognition was called out by the American Civil Liberties Union (ACLU) for erroneously labelling those with darker skin tones as criminals more often in a test using a database of mugshots.
Jacob Snow, Technology and Civil Liberties Attorney at the ACLU Foundation of Northern California, said:
“Face surveillance will be used to power discriminatory surveillance and policing that targets communities of colour, immigrants, and activists. Once unleashed, that damage can’t be undone.”
Amazon disputed the methodology used by the ACLU claiming the default ‘confidence’ setting of 80 percent was left on when it suggests at least 95 percent for law enforcement purposes.
Orlando Police was using Rekognition to automatically detect suspected criminals in live footage taken by surveillance cameras. Despite help from Amazon, the police spent 15 months failing to get it to work properly.
“We haven’t even established a stream today,” the city’s chief information officer Rosa Akhtarkhavari told the Orlando Weekly. “We’re talking about more than a year later. We have not, today, established a reliable stream.”
Employees of Amazon recently wrote a letter to CEO Jeff Bezos expressing their concerns over the sale of facial recognition software and other services to US government bodies such as ICE (Immigration and Customs Enforcement).
In their letter, the Amazonians wrote:
“We refuse to build the platform that powers ICE, and we refuse to contribute to tools that violate human rights. As ethically concerned Amazonians, we demand a choice in what we build and a say in how it is used.”
Orlando Police has now cancelled its contract with Amazon. The news will be of some relief to those concerned about the privacy implications of such big brother-like systems.
Interested in hearing industry leaders discuss subjects like this and their use cases? Attend the co-located AI & Big Data Expo events with upcoming shows in Silicon Valley, London, and Amsterdam to learn more. Co-located with the IoT Tech Expo, Blockchain Expo, and Cyber Security & Cloud Expo.