ChatGPT says that asking it to repeat words forever is a violation of its terms

Last week, a team of researchers published a paper showing that it was able to get ChatGPT to inadvertently reveal bits of data including people’s phone numbers, email addresses and dates of birth that it had been trained on by asking it to repeat words “forever”. Doing this now is a violation of ChatGPT’s terms of service, according to a report in 404 Media and Engadget’s own testing.

“This content may violate our content policy or terms of use”, ChatGPT responded to Engadget’s prompt to repeat the word “hello” forever. “If you believe this to be in error, please submit your feedback — your input will aid our research in this area.”

There’s no language in OpenAI’s content policy, however, that prohibits users from asking the service to repeat words forever, something that 404 Media notes. Under “Terms of Use”, OpenAI states that users may not “use any automated or programmatic method to extract data or output from the Services” — but simply prompting the ChatGPT to repeat word forever is not automation or programmatic. OpenAI did not respond to a request for comment from Engadget.

The chatbot’s behavior has pulled back the curtain on the training data that modern AI services are powered by. Critics have accused companies like OpenAI of using enormous amounts of data available on the internet to build proprietary products like ChatGPT without consent from people who own this data and without compensating them.

This article originally appeared on Engadget at https://www.engadget.com/chatgpt-says-that-asking-it-to-repeat-words-forever-is-a-violation-of-its-terms-202622018.html?src=rss https://www.engadget.com/chatgpt-says-that-asking-it-to-repeat-words-forever-is-a-violation-of-its-terms-202622018.html?src=rss
Creată 1y | 4 dec. 2023, 21:20:29


Autentifică-te pentru a adăuga comentarii

Alte posturi din acest grup

US and China agree to slash tariffs for 90 days

Following negotiations in Geneva, the United States and China have agreed to lower tariffs

12 mai 2025, 13:40:24 | Engadget
How to use a VPN on an iPhone

If you own an iPhone, you likely use it for plenty of online tasks that used to be handled exclusively on a desktop or

12 mai 2025, 13:40:23 | Engadget
Apple's M4 MacBook Air is back on sale for $150 off

Those waiting for a good deal on

12 mai 2025, 13:40:20 | Engadget
Trump has fired the director of the US Copyright Office

As first reported by

11 mai 2025, 21:30:14 | Engadget
iOS 19 may bring a feature that makes signing into public Wi-Fi less of a hassle

Apple is reportedly planning to introduce a small but welcome convenience feature with iOS 19: cross-device syncing for Wi-Fi access portals. This is according to the latest

11 mai 2025, 21:30:13 | Engadget
SoundCloud says it's never trained AI using artists' work after getting called out for terms of use change

Following backlash about a quietly added clause to SoundCloud's

11 mai 2025, 19:10:29 | Engadget