Speech recognition systems have higher error rates for black people, study finds

The study authors found that the systems — developed by the likes of Amazon, Apple, Google, IBM, and Microsoft — all have smaller error rates when transcribing the speech of white people.
By Jack Morse  on 
Speech recognition systems have higher error rates for black people, study finds
Pardon? Credit: DigitalVision Vectors / getty

No, you're not just imagining it. Speech recognition systems developed by the likes of Amazon, Apple, Google, IBM, and Microsoft all have higher error rates when transcribing speech from black people than when doing so for white people.

So finds a study published today in the Proceedings of the National Academy of Sciences, which notes that the increased prevalence of these systems in modern day life risks enshrining a new form of digital discrimination unless action is taken.

"Automated speech recognition (ASR) systems are now used in a variety of applications to convert spoken language to text, from virtual assistants, to closed captioning, to hands-free computing," wrote the study's authors. "Our results point to hurdles faced by African Americans in using increasingly widespread tools driven by speech recognition technology."

Researchers took 115 human-transcribed interviews — including conversations with 73 black speakers and 42 white speakers — and compared them to the versions produced by the tech giant's speech-recognition tools. They discovered an "average word error rate" of almost double (0.35) when the system transcribed black speakers as compared to when it transcribed white speakers (0.19)."

In other words, the systems worked noticeably worse for people of color.

Mashable Light Speed
Want more out-of-this world tech, space and science stories?
Sign up for Mashable's weekly Light Speed newsletter.
By signing up you agree to our Terms of Use and Privacy Policy.
Thanks for signing up!

This is far from the first time we've seen evidence of bias embedded in the supposed technology of tomorrow. In December of last year, a federal study once again confirmed that facial-recognition tech is a biased mess. In October of 2017, we saw that Google's text/sentiment-analysis tool exhibited signs of homophobia, racism, and antisemitism.

However, it's worth noting that with one quarter of U.S. adults claiming to have at least one smart speaker in their homes, the bias uncovered by today's study is likely affecting tens of millions (if not more) people right now.

SEE ALSO: Federal study confirms facial recognition is a biased mess

"With adoption of speech recognition systems likely to grow over time," the study authors continue, "we hope technology firms and other participants in this field foreground the equitable development of these important tools."

That'd sure be nice, wouldn't it?

Topics Amazon Google

Mashable Image
Jack Morse

Professionally paranoid. Covering privacy, security, and all things cryptocurrency and blockchain from San Francisco.


Recommended For You
The TikTok ban is law. Here's what happens next.
hand holding phone showing tiktok logo


Yes, 'You wouldn't last an hour in the asylum where they raised me' is a Taylor Swift lyric
Taylor Swift performing in a white dress surrounded by back up dancers in black outfits creating a haunting image.

Look out Substack, Ghost will join the fediverse this year
The Ghost logo.


More in Tech
How to turn off Meta AI
the Meta logo on a wall with a blurry reflected background

Rabbit R1: I spent 17 hours with it — and something's iffy about it
Rabbit R1 device in a woman's hand



Microsoft launches Phi-3 Mini, a tiny AI model that packs a punch
a futuristic rendering of a brain on top of a computing chip

Trending on Mashable
Wordle today: Here's the answer and hints for April 25
a phone displaying Wordle

NYT Connections today: See hints and answers for April 25
A phone displaying the New York Times game 'Connections.'

NYT Connections today: See hints and answers for April 24
A phone displaying the New York Times game 'Connections.'


Wordle today: Here's the answer and hints for April 24
a phone displaying Wordle
The biggest stories of the day delivered to your inbox.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use and Privacy Policy. You may unsubscribe from the newsletters at any time.
Thanks for signing up. See you at your inbox!