How Abeba Birhane is cleaning up AI’s dirty data

One day in 2020, Abeba Birhane found herself on Wikipedia, scouring a list of slurs. At the time, Birhane was pursuing a PhD in cognitive science at the University College Dublin and was trying to see how many of those slurs appeared in the image descriptions for a massive data set that’s often used to train AI systems. 

She had already turned up plenty of matches on the obvious filth, but Birhane was running out of ideas for what to search next. “The reason I went to Wikipedia is because I couldn’t think of enough slur words,” she says. 

As the list of terms grew, so did Birhane’s findings, until she had amassed enough evidence to co-author a paper detailing just how rampant derogatory terms were within this important bit of technological infrastructure. That paper prompted the Massachusetts Institute of Technology, which housed the data set, to take it offline, and cemented Birhane’s position as a leading auditor of the data sets that feed the world’s increasingly sophisticated AI models. Now Birhane is continuing that work under a newly launched independent research lab of her own, called the AI Accountability Lab.

Birhane’s research focuses on the fact that AI models are trained on massive quantities of unfiltered data scraped from the open internet, much of which consists of hateful 4chan boards and misogynistic porn sites. Without proper safeguards in place, those AI models can end up replicating the same hate and misogyny when people prompt them for answers later on. In one recent paper, Birhane and her co-authors found that the bigger data sets get, the more likely the AI models trained on them will produce biased results, like classifying Black people as criminals. 

“We are not evaluating systems for some hypothetical, potential risks in the future,” Birhane says. “These audits are uncovering actual real issues, real problems, whether it’s racism, sexism, or encoding of stereotypes and historical injustices and so on.” 

Birhane, who is from Ethiopia, said these questions about where data comes from and how it translates into biased outputs were not always top of mind in the research labs where she worked. “Traditional computer scientists tend to be male, white, or Asian. They would not think about how is Africanness represented? How are Black women represented?” she says. “My experience and background has effects in how I approach my audits.” 

Her work couldn’t come soon enough. There are already plenty of examples of flawed AI systems wreaking havoc on people’s lives. In the U.K., the government used an algorithmic grading tool to approximate students’ grades after their exams were canceled due to the pandemic, and wound up giving students from disadvantaged schools worse grades than affluent ones. In the Netherlands, the Dutch government used an algorithm to predict people’s risk of defrauding the child benefits system and ended up penalizing tens of thousands of lower-income people, some of whom had their children taken away from them.

“In all of these examples, you find that the people who go to jail, the people who are disfranchised, the people who are dying, the people who are negatively impacted are often people at the very margins of society,” Birhane says. “This is the dire cost of not evaluating algorithmic systems before we deploy them.”

<hr class=“wp-block-separator is-style-wide”/>

This story is part of AI 20, our monthlong series of profiles spotlighting the most interesting technologists, entrepreneurs, corporate leaders, and creative thinkers shaping the world of artificial intelligence.

<hr class=“wp-block-separator is-style-wide”/> https://www.fastcompany.com/91238006/how-abeba-birhane-is-cleaning-up-ais-dirty-data?partner=rss&amp;utm_source=rss&amp;utm_medium=feed&amp;utm_campaign=rss+fastcompany&amp;utm_content=rss

Létrehozva 7mo | 2024. dec. 10. 12:40:06


Jelentkezéshez jelentkezzen be

EGYÉB POSTS Ebben a csoportban

Yahoo Creators platform hits record revenue as publisher bets big on influencer-led content

Yahoo’s bet on creator-led content appears to be paying off. Yahoo Creators, the media company’s publishing platform for creators, had its most lucrative month yet in June.

Launched in M

2025. júl. 11. 17:30:04 | Fast company - tech
GameStop’s Nintendo Switch 2 stapler sells for more than $100,000 on eBay after viral mishap

From being the face of memestock mania to going viral for inadvertently stapling the screens of brand-new video game consoles, GameStop is no stranger to infamy.

Last month, during the m

2025. júl. 11. 12:50:04 | Fast company - tech
Don’t take the race for ‘superintelligence’ too seriously

The technology industry has always adored its improbably audacious goals and their associated buzzwords. Meta CEO Mark Zuckerberg is among the most enamored. After all, the name “Meta” is the resi

2025. júl. 11. 12:50:02 | Fast company - tech
Why AI-powered hiring may create legal headaches

Even as AI becomes a common workplace tool, its use in

2025. júl. 11. 12:50:02 | Fast company - tech
Gen Zers are posting their unemployment era on TikTok—and it’s way too real

Finding a job is hard right now. To cope, Gen Zers are documenting the reality of unemployment in 2025.

“You look sadder,” one TikTok po

2025. júl. 11. 10:30:04 | Fast company - tech
The most effective AI tools for research, writing, planning, and creativity

This article is republished with permission from Wonder Tools, a newsletter that helps you discover the most useful sites and apps. 

2025. júl. 11. 10:30:04 | Fast company - tech