OpenAI says it can detect images made by its own software… mostly

We all think we’re pretty good at identifying images made by AI. It’s the weird alien text in the background. It’s the bizarre inaccuracies that seem to break the laws of physics. Most of all, it’s those gruesome hands and fingers. However, the technology is constantly evolving and it won’t be too long until we won’t be able to tell what’s real or not. Industry leader OpenAI is trying to get ahead of the problem by creating a toolset that detects images created by its own DALL-E 3 generator. The results are a mixed bag.

The tool in action.
OpenAI

The company says it can accurately detect pictures whipped up by DALL-3 98 percent of the time, which is great. There are, though, some fairly big caveats. First of all, the image has to be created by DALL-E and, well, it’s not the only image generator on the block. The internet overfloweth with them. According to data provided by OpenAI, the system only managed to successfully classify five to ten percent of images made by other AI models.

Also, it runs into trouble if the image has been modified in any way. This didn’t seem to be a huge deal in the case of minor modifications, like cropping, compression and changes in saturation. In these cases, the success rate was lower but still within acceptable range at around 95 to 97 percent. Adjusting the hue, however, dropped the success rate down to 82 percent.

Results from the test.
OpenAI

Now here’s where things get really sticky. The toolset struggled when used to classify images that underwent more extensive changes. OpenAI didn’t even publish the success rate in these cases, stating simply that "other modifications, however, can reduce performance.”

This is a bummer because, well, it’s an election year and the vast majority of AI-generated images are going to be modified after the fact so as to better enrage people. In other words, the tool will likely recognize an image of Joe Biden asleep in the Oval Office surrounded by baggies of white powder, but not after the creator slaps on a bunch of angry text and Photoshops in a crying bald eagle or whatever.

At least OpenAI is being transparent regarding the limitations of its detection technology. It’s also giving external testers access to the aforementioned tools to help fix these issues, as reported by The Wall Street Journal. The company, along with bestie Microsoft, has poured $2 million into something called the Societal Resilience Fund, which hopes to expand AI education and literacy.

Unfortunately, the idea of AI mucking up an election is not some faraway concept. It’s happening right now. There have already been AI-generated election ads and disingenuous images used this cycle, and there’s likely much more to come as we slowly, slowly, slowly (slowly) crawl toward November.

This article originally appeared on Engadget at https://www.engadget.com/openai-says-it-can-detect-images-made-by-its-own-software-mostly-170012976.html?src=rss https://www.engadget.com/openai-says-it-can-detect-images-made-by-its-own-software-mostly-170012976.html?src=rss
Creată 13d | 7 mai 2024, 17:50:20


Autentifică-te pentru a adăuga comentarii

Alte posturi din acest grup

Sam Altman is ‘embarrassed’ that OpenAI threatened to revoke equity if exiting employees wouldn’t sign an NDA

OpenAI reportedly made exiting employees choose between keeping their vested equity and being able to speak out against the company. According to

19 mai 2024, 19:40:10 | Engadget
Indie developers are trying to make horse games that don’t suck. It’s not easy

Video game horses tend to play a fairly uncomplicated role, at least in mainstream titles. Like semi-sentient meat bicycles, they often exist as little more than a way to make the player travel fas

19 mai 2024, 15:10:10 | Engadget
Blue Origin successfully sends tourists to the edge of space again after a long hiatus

Blue Origin is back in the space tourism game. Jeff Bezos’ spaceflight company successfully flew six paying customers to the edge of space and back this morning, breaking its nearly two-year-long h

19 mai 2024, 15:10:09 | Engadget
Apple will reportedly offer higher trade-in credit for old iPhones for the next two weeks

It might be a good time to finally upgrade your iPhone if you’ve been hanging onto an older model — according to Bloomberg’s

18 mai 2024, 23:10:11 | Engadget
New trailer for Dead Cells: Immortalis gives us a first real look at the animated series

A full trailer just dropped for the upcoming animated show based on the popular game Dead Cells, and it looks like the creators have made a few unexpected choices. For one, the Beheaded ca

18 mai 2024, 18:40:04 | Engadget
Beats headphones and earbuds with AppleCare+ are on sale at Amazon

Several models of Beats headphones and earbuds are deeply discounted right now in a deal from Amazon, including the noise-canceling

18 mai 2024, 16:20:11 | Engadget