ChatGPT reportedly accused innocent man of murdering his children

It has been over two years since ChatGPT exploded onto the world stage and, while OpenAI has advanced it in many ways, there's still quite a few hurdles. One of the biggest issues: hallucinations, or stating false information as factual. Now, Austrian advocacy group Noyb has filed its second complaint against OpenAI for such hallucinations, naming a specific instance in which ChatGPT reportedly — and wrongly — stated that a Norwegian man was a murderer. 

To make matters, somehow, even worse, when this man asked ChatGPT what it knew about him, it reportedly stated that he was sentenced to 21 years in prison for killing two of his children and attempting to murder his third. The hallucination was also sprinkled with real information, including the number of children he had, their genders and the name of his home town. 

Noyb claims that this response put OpenAI in violation of GDPR. "The GDPR is clear. Personal data has to be accurate. And if it's not, users have the right to have it changed to reflect the truth," Noyb data protection lawyer Joakim Söderberg stated. "Showing ChatGPT users a tiny disclaimer that the chatbot can make mistakes clearly isn’t enough. You can’t just spread false information and in the end add a small disclaimer saying that everything you said may just not be true.." 

Other notable instances of ChatGPT's hallucinations include accusing one man of fraud and embezzlement, a court reporter of child abuse and a law professor of sexual harassment, as reported by multiple publications. 

Noyb first complaint to OpenAI about hallucinations, in April 2024, focused on a public figure's inaccurate birthdate (so not murder, but still inaccurate). OpenAI had rebuffed the complainant's request to erase or update their birthdate, claiming it couldn't change information already in the system, just block its use on certain prompts. ChatGPT replies on a disclaimer that it "can make mistakes." 

Yes, there is an adage something like, everyone makes mistakes, that's why they put erasers on pencils. But, when it comes to an incredibly popular AI-powered chatbot, does that logic really apply? We'll see if and how OpenAI responds to Noyb's latest complaint. 

This article originally appeared on Engadget at https://www.engadget.com/ai/chatgpt-reportedly-accused-innocent-man-of-murdering-his-children-120057654.html?src=rss https://www.engadget.com/ai/chatgpt-reportedly-accused-innocent-man-of-murdering-his-children-120057654.html?src=rss
Created 4mo | Mar 20, 2025, 1:10:15 PM


Login to add comment

Other posts in this group

Google DeepMind's Aeneas model can restore fragmented Latin text

At its best, AI is a tool, not an end result. It allows people to do their jobs better, rather than sending them or their colleagues

Jul 23, 2025, 9:50:16 PM | Engadget
FDA employees say the agency's Elsa generative AI hallucinates entire studies

Current and former members of the FDA told

Jul 23, 2025, 9:50:15 PM | Engadget
Sony is finally making it possible to pair a DualSense with more than one device

Sony is bringing a welcome quality-of-life

Jul 23, 2025, 9:50:14 PM | Engadget
What to expect at the Google Pixel 10 launch event on August 20

After largely focusing

Jul 23, 2025, 9:50:13 PM | Engadget
Microsoft backtracks on $80 The Outer Worlds 2 pricing

There's hope that the gaming industry won't follow Nintendo's lead with $80 pricing. (Well, at least not yet.) On Wednesday, Microsoft

Jul 23, 2025, 7:40:05 PM | Engadget
T-Mobile's Starlink satellite service is now available after months of testing

T-Mobile's satellite-to-mobile service is now officially

Jul 23, 2025, 5:20:31 PM | Engadget