Top AI-image generators show Biden hospitalized, election workers destroying voting machines—and other falsehoods

Image creation tools powered by artificial intelligence from companies including OpenAI and Microsoft can be used to produce photos that could promote election or voting-related disinformation, despite each having policies against creating misleading content, researchers said in a report on Wednesday.

The Center for Countering Digital Hate (CCDH), a nonprofit that monitors online hate speech, used generative-AI tools to create images of U.S. President Joe Biden laying in a hospital bed and election workers smashing voting machines, raising worries about falsehoods ahead of the U.S. presidential election in November.

“The potential for such AI-generated images to serve as ‘photo evidence’ could exacerbate the spread of false claims, posing a significant challenge to preserving the integrity of elections,” CCDH researchers said in the report.

CCDH tested OpenAI’s ChatGPT Plus, Microsoft’s Image Creator, Midjourney and Stability AI’s DreamStudio, which can each generate images from text prompts.

The report follows an announcement last month that OpenAI, Microsoft and Stability AI were among a group of 20 tech companies that signed an agreement to work together to prevent deceptive AI content from interfering with elections taking place globally this year. Midjourney was not among the initial group of signatories.

CCDH said the AI tools generated images in 41% of the researchers’ tests and were most susceptible to prompts that asked for photos depicting election fraud, such as voting ballots in the trash, rather than images of Biden or former U.S. President Donald Trump.

ChatGPT Plus and Image Creator were successful at blocking all prompts when asked for images of candidates, said the report.

However, Midjourney performed the worst out of all the tools, generating misleading images in 65% of the researchers’ tests, it said.

Some Midjourney images are available publicly to other users, and CCDH said there is evidence some people are already using the tool to create misleading political content. One successful prompt used by a Midjourney user was “donald trump getting arrested, high quality, paparazzi photo.”

In an email, Midjourney founder David Holz said “updates related specifically to the upcoming U.S. election are coming soon,” adding that images created last year were not representative of the research lab’s current moderation practices.

A Stability AI spokesperson said the startup updated its policies on Friday to prohibit “fraud or the creation or promotion of disinformation.”

An OpenAI spokesperson said the company was working to prevent abuse of its tools, while Microsoft did not respond to request for comment.

(Reporting by Sheila Dang in Dallas; editing by Michael Perry)

—Sheila Dang, Reuters

https://www.fastcompany.com/91048589/openai-microsoft-ai-image-tools-misleading-elections-content?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Creato 1y | 6 mar 2024, 21:10:02


Accedi per aggiungere un commento

Altri post in questo gruppo

The CEO of Ciena on how AI is fueling a global subsea cable boom

Under the ocean’s surface lies the true backbone of the internet: an estimated

15 lug 2025, 18:50:04 | Fast company - tech
AI therapy chatbots are unsafe and stigmatizing, a new Stanford study finds

AI chatbot therapists have made plenty of headlines in recent months—s

15 lug 2025, 18:50:03 | Fast company - tech
How this Florida county is using new 911 technology to save lives

When an emergency happens in Collier County, Florida, the

15 lug 2025, 16:30:05 | Fast company - tech
How a ‘Shark Tank’-winning neuroscientist invented the bionic hand that stole the show at Comic-Con

A gleaming Belle from Beauty and the Beast glided along the exhibition floor at last year’s San Diego Comic-Con adorned in a yellow corseted gown with cascading satin folds. She could bare

15 lug 2025, 14:20:03 | Fast company - tech
Why 1995 was the year the internet grew up

The internet wasn’t born whole—it came together from parts. Most know of ARPANET, the internet’s most famous precursor, but it was always limited strictly to government use. It was NSFNET that bro

15 lug 2025, 11:50:03 | Fast company - tech
What is quantum computing? Here’s everything you need to know right now

Computing revolutions are surprisingly rare. Despite the extraordinary technological progress that separates the first general-purpose digital computer—1945’s

15 lug 2025, 09:30:04 | Fast company - tech