AI hallucinations could get lawyers fired, law firm says

U.S. personal injury law firm Morgan & Morgan sent an urgent email this month to its more than 1,000 lawyers: Artificial intelligence can invent fake case law, and using made-up information in a court filing could get you fired.

A federal judge in Wyoming had just threatened to sanction two lawyers at the firm who included fictitious case citations in a lawsuit against Walmart. One of the lawyers admitted in court filings last week that he used an AI program that “hallucinated” the cases and apologized for what he called an inadvertent mistake.

AI’s penchant for generating legal fiction in case filings has led courts around the country to question or discipline lawyers in at least seven cases over the past two years, and created a new high-tech headache for litigants and judges, Reuters found.

The Walmart case stands out because it involves a well-known law firm and a big corporate defendant. But examples like it have cropped up in all kinds of lawsuits since chatbots like ChatGPT ushered in the AI era, highlighting a new litigation risk.

A Morgan & Morgan spokesperson did not respond to a request for comment. Walmart declined to comment. The judge has not yet ruled whether to discipline the lawyers in the Walmart case, which involved an allegedly defective hoverboard toy.

Advances in generative AI are helping reduce the time lawyers need to research and draft legal briefs, leading many law firms to contract with AI vendors or build their own AI tools. Sixty-three percent of lawyers surveyed by Reuters’ parent company Thomson Reuters last year said they have used AI for work, and 12% said they use it regularly.

Generative AI, however, is known to confidently make up facts, and lawyers who use it must take caution, legal experts said. AI sometimes produces false information, known as “hallucinations” in the industry, because the models generate responses based on statistical patterns learned from large datasets rather than by verifying facts in those datasets.

Attorney ethics rules require lawyers to vet and stand by their court filings or risk being disciplined. The American Bar Association told its 400,000 members last year that those obligations extend to “even an unintentional misstatement” produced through AI.

The consequences have not changed just because legal research tools have evolved, said Andrew Perlman, dean of Suffolk University’s law school and an advocate of using AI to enhance legal work.

“When lawyers are caught using ChatGPT or any generative AI tool to create citations without checking them, that’s incompetence, just pure and simple,” Perlman said.

‘Lack of AI literacy’

In one of the earliest court rebukes over attorneys’ use of AI, a federal judge in Manhattan in June 2023 fined two New York lawyers $5,000 for citing cases that were invented by AI in a personal injury case against an airline.

A different New York federal judge last year considered imposing sanctions in a case involving Michael Cohen, the former lawyer and fixer for Donald Trump, who said he mistakenly gave his own attorney fake case citations that the attorney submitted in Cohen’s criminal tax and campaign finance case.

Cohen, who used Google’s AI chatbot Bard, and his lawyer were not sanctioned, but the judge called the episode “embarrassing.”

In November, a Texas federal judge ordered a lawyer who cited nonexistent cases and quotations in a wrongful termination lawsuit to pay a $2,000 penalty and attend a course about generative AI in the legal field.

A federal judge in Minnesota last month said a misinformation expert had destroyed his credibility with the court after he admitted to unintentionally citing fake, AI-generated citations in a case involving a “deepfake” parody of Vice President Kamala Harris.

Harry Surden, a law professor at the University of Colorado’s law school who studies AI and the law, said he recommends lawyers spend time learning “the strengths and weaknesses of the tools.” He said the mounting examples show a “lack of AI literacy” in the profession, but the technology itself is not the problem.

“Lawyers have always made mistakes in their filings before AI,” he said. “This is not new.”

—Sara Merken, Reuters


https://www.fastcompany.com/91280650/ai-hallucinations-could-get-lawyers-fired-law-firm?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Létrehozva 7mo | 2025. febr. 19. 1:20:05


Jelentkezéshez jelentkezzen be

EGYÉB POSTS Ebben a csoportban

Kalshi found a backdoor to sports gambling, and is throwing it open to everyone

Last month, the online prediction market Kalshi filed some very dry but potentially very lucrative paperwork with t

2025. szept. 6. 12:50:03 | Fast company - tech
A slimmer iPhone and new Apple Watches: What to expect from Apple’s September 9 launch event

Apple holds several events throughout the year, but none is as vital to the company’s bottom line as its annual one in September. That’s when Apple unveils its new iPhone lineup, drawing our atten

2025. szept. 6. 10:30:04 | Fast company - tech
From Kindle to Kobo and beyond, this free ebook depot will blow your mind

The first time I read The Count of Monte Cristo, I was astounded by how freakin’ cool it all was. Here’s a story about daring prison escapes, finding hidden treasure, and elaborately exec

2025. szept. 6. 10:30:04 | Fast company - tech
TikTok is obsessed with this guy who bought an abandoned golf course in Maine

Buying an abandoned golf course and restoring it from scratch sounds like a dream for many golf fans. For one man in Maine, that dream is now reality.

A user who posts under the handle @

2025. szept. 5. 22:50:05 | Fast company - tech
Andreessen Horowitz is not a venture capital fund

I was reading funding news last week, and I came to a big realization: Andreessen Horowitz is not a venture capital fund.

A lot of people are thinking it. So there, I said it.

2025. szept. 5. 20:30:11 | Fast company - tech
Fake Holocaust AI slop is flooding social media

A post circulating on Facebook shows a man named Henek, a violinist allegedly forced to play in the concentration camp’s orchestra at Auschwitz. “His role: to play music as fellow prisoners

2025. szept. 5. 20:30:09 | Fast company - tech
Think this AI-generated Italian teacup on your kid’s phone is nonsense? That’s the point

In the first half of 2025, she racked up over 55 million views on TikTok and 4 mil

2025. szept. 5. 20:30:08 | Fast company - tech