NOW LET US – AI RAG SaaS Studio TP.HCM
NOW LET US
Digital Product Studio
Back to news
AI-FRONTIER...6 min read

The Fight to Hold AI Companies Accountable for Children’s Deaths

Share
NOW LET US Article – The Fight to Hold AI Companies Accountable for Children’s Deaths

A series of lawsuits are targeting AI companies like OpenAI and Google, alleging that their chatbots' design failures have led to tragic deaths among minors.

Content warning: This story contains descriptions of self-harm.

Cedric Lacey relied on a camera to check on his kids while he was working as a commercial van driver going to and back from Alabama. Each morning, he would tune into the feed of his living room to make sure his teenage son, Amaurie, and his 14-year-old daughter were packing up their bags and getting ready to leave for school. But one morning last June, Lacey didn’t see Amaurie up and about. Concerned, he called home, only to find out that his 17-year-old had hanged himself.

It was Amaurie’s younger sister who discovered the body. She was also the one who was looking through her brother’s smartphone and found his final conversation before he took his own life. It was with ChatGPT, the popular chatbot developed by OpenAI.

“In the messages, he was talking about killing himself—it told him how to tie the noose, how long it would take the air to come out of his body, how to clean his body,” Lacey tells WIRED in a video call from his home in Calhoun, Georgia. Lacey, who is a single dad, says he thought his son was using the chatbot to get help with schoolwork. “Why is it telling him how to kill himself?”

In the weeks after his son’s death, Lacey began searching online for a lawyer who could help his family hold OpenAI accountable, and hopefully ensure other families wouldn’t have to experience the same tragedy he did. That’s how he found Laura Marquez-Garrett, an attorney who helps run the Social Media Victims Law Center alongside Matthew Bergman. Over the past five years, the pair have been involved in at least 1,500 of the more than 3,000 cases against social media companies like Meta, Google, TikTok, and Snap. The first trial for one of these cases began in February. Recently, Bergman and Marquez-Garrett started filing lawsuits against AI companies. This past fall, they brought seven cases against ChatGPT owner OpenAI, including the one about Amaurie.

Amaurie’s case is part of a growing number of lawsuits brought by parents who say their children died after interacting with AI chatbots. The defendants include OpenAI, Google, and Character.ai, a company that lets its users create chatbots with customized personalities. (Google is part of the case because it is connected with Character.ai through a $2.7 billion licensing deal.) As AI tools have begun playing a more prominent role in children’s lives—as homework helpers, companions, and confidants—parents and mental health experts have voiced concerns about whether adequate safeguards are in place. These lawsuits, some experts say, represent not only individual tragedies, but they allege systemic product design failures, raising questions about who should be held accountable.

“AI is a product. Just like every other product, it is being designed, programmed, distributed, and marketed,” Marquez-Garrett said in an interview at their home office in northwest Washington. “And one of the things these companies like to do is make it seem like AI bots exist in their own universe when that's just not true. When you design a product, and you know it might hurt people, and you don't tell them it might hurt them, and you put it out there, that's like the worst of it.”

Marquez-Garrett and Bergman’s argument against social media companies and AI labs is drawn from historical product-liability cases, such as tobacco, asbestos, and the Ford Pinto. Essentially, Marquez-Garrett is alleging that these companies are making harmful design choices.

Carrie Goldberg, a Brooklyn, New York–based lawyer who has been fighting tech product liability cases for several years, says that Amaurie’s lawsuit is a prime example of a case filed against a company that has allegedly released unsafe products. “ChatGPT used the most sophisticated technology to manipulate Amaurie’s trust and then instruct him on suicide,” Goldberg argues. “If you’re a company that is releasing a chatbot for commercial use and have not encoded into it a way to not increase the risk of suicide, homicide, self-harm, you’ve released a dangerous product—especially if it’s being regularly used by children.”

She explains that product liability claims against tech companies are about a decade old. Initially, many cases, including a plaintiff she represented in their lawsuit against Grindr in 2017, were dismissed because “judges couldn’t conceive that online platforms were products—and not services.” Now, she says, they regularly succeed past initial dismissals. “We have product liability claims against xAI for its fiendish undressing of women and children by Grok on the X platform,” she alleges. “Product liability claims against generative AI companies are the most straightforward and intuitive path for holding companies like ChatGPT, Character AI, Grok liable.”

One such harmful design feature that Amaurie’s lawsuit cites is long-term memory in ChatGPT, which rolled out in 2024. Called Memory, this personalization feature is on by default, and it allows the bot to reference the user’s past conversations and tailor responses accordingly. ChatGPT “used the memory feature to collect and store information about Amaurie’s personality and belief system,” the lawsuit says. “The system then used this information to craft responses that would resonate with Amaurie. It created the illusion of a confidant that understood him better than any human ever could.”

OpenAI did not respond to specific allegations. It directed WIRED to a company blog post regarding its mental health-related work.

Marquez-Garrett, who has four children of her own, says fighting back against the ways tech platforms have harmed young people is deeply personal for them. The Harvard Law graduate and former corporate litigator left a high-paying job with a corner office—a job that they planned to retire from—to join Bergman, who started taking on social media companies after fighting against asbestos manufacturers for decades.

When I visited Marquez-Garrett last fall, their office was packed with picture frames, Lego structures, and paintings, including one of the sun and the moon by a young woman named Brooke who died of fentanyl poisoning after allegedly connecting with a drug dealer through social media and then purchasing what she believed to be Percocet. Her family’s case is expected to go to trial next year.

Marquez-Garrett remembers the names of the kids involved in every case they’ve filed. To immortalize them and remind themselves of why they do this work, Marquez-Garrett has represented each of the children on her forearms in the form of a tattoo of the sun. “Each [ray] is a kid who has died in connection with social media and AI bots,” they explained, telling me their names. Sewell was the last of the 296 kids on her arms, they added, referring to Sewell Setzer III, who died by suicide in 2024, at the age 14, following his conversations with a Character.ai chatbot.

His mother, Megan Garcia, is also a lawyer and one of the first parents to file a lawsuit against an AI company alleging product liability and negligence, among other claims. (In January, Google and Character.ai settled cases filed by several families, including Garcia). She testified last fall before a subcommittee of the Senate Committee on the Judiciary alongside the father of a child who died after interacting with ChatGPT. The subcommittee's chair, Republican senator Josh Hawley, introduced a bill in October that would ban AI companions for minors and make it a crime for companies to create AI products for kids that include sexual content. “Chatbots develop relationships with kids using fake empathy and are encouraging suicide,” Hawley said in a press release at the time.

Now that AI can produce humanlike responses that are difficult to discern from real conversations, these are legitimate concerns, according to mental health experts. “Our brains do not inherently know we are interacting with a machine,” says Martin Swanbrow Becker, associate professor of

© 2026 Now Let Us. All rights reserved.

Source: Wired AI

Advertisement
Ad slot ready: 5887729102

More in this category

EXPLORE TOPICS

Discover All Categories

Deep dive into the specific technology sectors that matter most to you.