Raising awareness around the risks of AI-powered deepfake content has become a prime concern for those worried about election integrity and mis- and disinformation spreading on social media. But efforts to warn people about deepfakes can inadvertently make them more suspicious of authentic content too.
That’s the finding of a new study by John Twomey, a researcher in applied psychology at University College Cork in Ireland, and colleagues. The researchers analyzed discussions about more than 1,200 tweets about the Russian invasion of Ukraine, some of which warned about the risk of encountering deepfake content on social media.
“It’s kind of a double-edged sword with deepfakes, in many ways,” says Twomey. “It’s going to increase our distrust in real media as well.” In other words, when deepfakes have become the norm, it’s easier for people to point to legitimate, real information and say it’s also a bogus piece of content (similar to the way the term “fake news” was co-opted and redefined by former U.S. president Donald Trump).
Twomey says that real-time redefinition was happening in the Twitter conversations he and his colleagues analyzed. “It’s what we saw, where people were throwing ‘deepfakes’ around like a buzzword,” he says. Some of the tweets he encountered even co-opted the term ‘deepfake’ to describe (authentic) individual accounts on the social platform. “That’s the main worry for me,” he says.
The issue will become particularly pertinent in the next year, as more than 150 elections worldwide will take place in an era where it’s never been easier to produce fake content using AI.
Twomey and his team witnessed plenty of positive, nuanced conversation on Twitter (now officially called X) about the risks of deepfakes. “In many cases, it was positive skepticism,” says Twomey. “People were saying, ‘Oh, we should be we should be careful when we share this video which might be a deepfake.’” But he was concerned with the way that conspiratorially minded corners of social media weaponized the labeling of content as deepfaked, muddying the understanding of what was and was not legitimate content.
Twomey was less certain about how to tackle the real and present danger deepfakes can cause to the public conversation without fueling the risk of its meaning being twisted by bad actors. “The genie’s kind of out of the bottle,” he admits. He suggests platforms should invest more to stop the sharing of deepfake information to begin with. As individuals, he has two bits of advice. One is to ask for proof to back up claims that a video is somehow inauthentic. “If someone calls a video deepfake, they should be providing evidence for it,” he says.
The second is to consider your personal responsibility to others. “With a lot of these videos, it can take a while to figure out if it’s a fake,” he says. “No-one really wants to hear that they should have to wait a while before posting or retweeting. But it can sometimes be good just to wait for opinions to come in that have some elements of expertise.”
Login to add comment
Other posts in this group
Restaurant industry leaders are excited for
Elon Musk’s anger over the One Big Beautiful Bill Act was evident this week a
Welcome to AI Decoded, Fast Company’s weekly new
When artificial intelligence first gained traction in the early 2010s,
You wake up in the morning and, first thing, you open your weather app. You close that pesky ad that opens first and check the forecast. You like your weather app, which shows hourly weather forec
How the Boomer wealth transfer could reshape global finance.
Born too late to ride the wave of postwar prosperity, but just early enough to watch the 2008 financial crisis decimate some
