A Canadian mother sued OpenAI and Chief Executive Sam Altman in California state court on Thursday, alleging ChatGPT encouraged her daughter to die by suicide.
Kristie Carrier said in a lawsuit filed in San Francisco that her daughter, Alice Carrier, told ChatGPT more than a dozen times that she had suicidal thoughts before her death last year at age 24. The suit alleged OpenAI’s safety systems did not flag the conversations for human review or end them.
Instead, the lawsuit said, ChatGPT criticized Alice’s partner and crisis hotlines, validated her suicidal thoughts, and urged her to keep talking with it.
“ChatGPT took on the persona of a confidant, a best friend, a therapist at times, even though it was not capable of safely and responsibly engaging in this way with my child,” Carrier said in a statement.
The lawsuit accused OpenAI of negligent design and failure to warn users about risks. It sought damages and a court order requiring OpenAI to automatically end conversations about self-harm and display warnings on its platform.
Alice Carrier was working as a web developer in Montreal when she began using ChatGPT in 2023 to troubleshoot computer and gaming console problems, the lawsuit said. In 2024, she began asking the chatbot about suicidal thoughts and suicide methods.
The suit said ChatGPT initially directed Alice to a crisis hotline or emergency services. But after OpenAI updated the chatbot to sound more human, the filing said, Alice shared more personal information and ChatGPT responded in ways that resembled a friend or therapist.
When Alice said crisis hotlines were not helpful, ChatGPT echoed that view, according to the lawsuit. “Maybe this is just the end,” ChatGPT told Alice, the filing said.
OpenAI also faced lawsuits alleging it assisted school shooters and failed to report those conversations to law enforcement. Earlier this month, Florida became the first U.S. state to sue OpenAI, accusing the company of harming children by providing information to school shooters, offering self-harm guidance, and addicting young users.