Last week, a team of researchers published a paper showing that it was able to get ChatGPT to inadvertently reveal bits of data including people’s phone numbers, email addresses and dates of birth that it had been trained on by asking it to repeat words “forever”. Doing this now is a violation of ChatGPT’s terms of service, according to a report in 404 Media and Engadget’s own testing.
“This content may violate our content policy or terms of use”, ChatGPT responded to Engadget’s prompt to repeat the word “hello” forever. “If you believe this to be in error, please submit your feedback — your input will aid our research in this area.”
There’s no language in OpenAI’s content policy, however, that prohibits users from asking the service to repeat words forever, something that 404 Media notes. Under “Terms of Use”, OpenAI states that users may not “use any automated or programmatic method to extract data or output from the Services” — but simply prompting the ChatGPT to repeat word forever is not automation or programmatic. OpenAI did not respond to a request for comment from Engadget.
The chatbot’s behavior has pulled back the curtain on the training data that modern AI services are powered by. Critics have accused companies like OpenAI of using enormous amounts of data available on the internet to build proprietary products like ChatGPT without consent from people who own this data and without compensating them.
This article originally appeared on Engadget at https://www.engadget.com/chatgpt-says-that-asking-it-to-repeat-words-forever-is-a-violation-of-its-terms-202622018.html?src=rss https://www.engadget.com/chatgpt-says-that-asking-it-to-repeat-words-forever-is-a-violation-of-its-terms-202622018.html?src=rssLogin to add comment
Other posts in this group
A nearly year-old Facebook event for a "simple maths competition" has been one of the most viral posts on the platform for six months. The "event" racked up about 51 million views on Facebook durin
Tinder helped popularize a modern dating culture that puts looks first, and now the app is trying out a new way to capitalize on it. As part of a test, select Tinder Gold and Tinder Platinum subscr
YouTube Shorts is beta testing the addition of Google Lens. Integrating this tech into the short-form video platform will allow viewers to search for more information about what they can see in a c
J Allard, a former Microsoft executive and the mind behind the Zune, is leadin
